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List of Reports to NSF, June -22, 1976-July 1, 1977 
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J 

June, 1976 to July 1,' 1976 
July, 1976 to- August 3, 1976 
Apeust, 1976 to September 1, 1976 
' SepCenber, 1976 to Octpber^, ;976 
Dtiiirterly Report - November 20, 1976 
Obtqmer, 19?6 • 
^•'Novepb^r, 1976 

' December ^ 1976 to Decesaber 31, 1976 
January, 1977 to Fel^ruary S, 1977 
February, 19i7 ' . 
March, 1977 to March 3b, 1977 
AprfVl977 to Hay 1, 1977 
May, 1977 to JuneAo, 1977 

« 

June,- 1977 



2 pages • , 
2 pages 
^3 pages 

2 pages 

^ II l>ag^ and 39 pages (appehdix) 
>%one • ' s 

Hone 

3 pages 

2 pages ^ 

}%pne 

2 pages 

2 pages / 

18 pages' 

Jvone 
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. Suyaaary of Project Proposal 

« » 

k. Sumsry of grant proposal: ^ ' ^ - 

While the proli^ration of scientific literature over the past few decades ^ 
has been a tiatter of increasing concern to the scientific coraunlty, it ^jas created 
even greater problens for the undergraduate science student tl^an for the trained 
scientist. For the latter, th^ prpblea is prlcarily one of physical access, but 
the student does not even know where or how tl begin to iook for Mterlals. While 
the never curricula in sciencfc education place core end oore csphasis on independent 
study and use of recent research findings^ students, because they are not taught 
how to iise the literature of science, depend on the nethods and tools they were 
taught in high school, and never learn how' to use scientific ^bibliography v6ll 
until they are well along in gradxiate prograns. They say never experience as 
undergraduates the excitenent of finding the key articles that shad new light on 
their explorations » * ^ 

Yet it is not difficult to teach the strategy of aearching scientific liter- 
ature, and it can be done oost effectively within the structure of eatty present 
courses ^ And, as we have discovered at Earlhas aft^jr ten years of such experience, 
teaching students hov to tise scientific bibliography can contribute enopously 
to their interest in a course — even on a frcshaan level---and will encourage stadents 
to work Dore independently and to dig nore deeply than they would otherwise. . 

This project attcapts tfae dcvelc^ent of techniques for Itsprovlng the 
literature use skljLls of the undergraduate science students which can be used 
within existing courses > and attespts discUsslon and .application of these techniques . 
in selected Institutions • These activities vlll t)e follovad by dt^seadnaticn 
of the results to the library and sdeiice education prof'eMlons. 
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B. Changes, in, focus and intent, and organization of the project: ^ 

The original concept for the project involved, bringing together teams of 
librarian and teaching faulty froo selected institutions. These teacs were to 
participate in thr^e workshops/conferences: (1) August, (2) Deceiver, and (3) May 
or Junt. Because of the lateness in notification of the grant award we had to 
abandon t;he three' workshop nodel and go to two. 

The Intent of ttfe project was to assist selected institutions in the 
devtlopaent of -their, library instrucTtion prograns. It was expected that the 
developsentyrf effective workshop activities would assist the participants in 
■ the developcent of a progran designed for library and literature use to a specific 
clissor classes which the faculty eeeber teaches. 

1 

* \ 

The Project JHractor attended a oeeting of grantees and ^bers of the 
Reader Panel of the propo'sals in lage Ju^y, 1976. In the' discussions at the 
neeting end' in subsequent discussions vith Dr. Carole Oanx it becaae clear that 
the proj^ec'^should concerned ^th two levels of operation. 

f 1. Preparation of workshop laaterials and activities to educate 
and assist tea© oes^ers froe participant institutions. 

Il» Assess the ispact.of the workshops and other Proiect related 

activities on the library. and literature use in^ruction ' 
, ^ activities of the participant /institutions* 

' . • : ^ . • 

In order to acbtjsve this change In focus the consultants to the -project 

were given a wider range^ of responsibilities than had originally been planned. 

Instead of ^ us t evaluating the workahop i^^fl^ suggestltfg laproveaents 

in it, they tfere asked al«o|to considra: soise of th^ wider context In which the 

projedt was being carried out,' Jerry Bakker- was .ifeked to address the workshop 
*' ■ * . 

on the issue of -^brary instruction and faculty deveioptsent in* addition to 
tviltftting tht ,work«hop» «nd Sttvt HtUen was taked ta. wtltt tht Pro]tet - ' 



Director In developing &ttategie« foy^essing the' iiapact of th6 project. 
Steve haa already made an itiitial suggestion .which Is r'eported in Figure- 1 
here. More detailed plans yill be one of the activities to be undert&en 
during the second year of the project. 
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I» Selection of .Project Participants'" * 

\ • • 
*In order to select the Project participants -Onder the' severe time 
restraints wfe faced,- the ,ffflount of advertising of the Project watf limited. ' 
. A brief description of t^^e Project (Appendix I) was sent to approximately 
75 institutions which had .been identified as academic institutions ^iresently 
giving course related library Instruction In the sciences. Additional 
iMpiea were sent to the eleven p^t^icipating' institutions in the HEW Fund 
for Improvement of Post-Secondary Education's Natiokf Pfojept III, and to 
Library Journal/Hotline .- 

This brief announcement called for interested parties to request a I 
fuller description of theJ'roject and' an application form" (see Appendix I). 
Subsequently^ we received 43 req^s for mosp Information and from xhoa^e" 



A3, we rece>^ed twelve applications. - Below l,s a st^stical sumnary of. 



the applicants. 

Area of # of 
Country Requests 

East 16 

Southeast 5 

Midwest 15 

West . 3 

Southwest 3 

Canada 1 



9 of 

Applications 
2 

3 y 
1 

. 2 - . 
0 



Size of Ixtatktution 



0 to 1500- 400{ 

1500 4000 go.ot 



1 
1 
0 
0 

1 

0 



1 

, 0 

- 1 

0 
0 
0 



2 
1 
0 
0 
0 
0 



over 
10.000 

0 

0 

2 

1 ■ 

1 

0 



1 



Type 
Graduate & 
Dndergrad 

3 

■ 1 
2 ^ 
1 

0 



Under- 
grad 

1 ^. 
. 1 



1 
Q 
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r^gure 2: Susiaary of Characteristics .o^ Applicmits 'to Participate 
in Project 

The most dliftrcssing aspacft of the applicant podl was the lukk of appli- 
cants in the Mathematical, Physical aqd Engineering Science^. The subject" 
breakdown of the applicants vast Biophysics 1; Biology 2; Pood^nd Hutrltipn 
Ij^ Microbiology a-; and Social Sdencea In consultation with Dr. qkrole 
Gan?^ the Project W^rector dedided to postpone iliBClslotis on participants which 
was to have' bean made by August 10, 1976,-. while we sea^clied for potential ' 
participants in the non-rpprwented areas. About four to slic initial contacts 
were aadc which eventually 1^ d to tjfo aiJplicmnts'j one in Mathematics and 

'•'9 



and on^ In Engineering, Fronvr this pool of 15 applicants four were selected. 
, The names of the institutions and the team members and their positions are 
listed below; ' ^ ' ' 

University of Arizona (Tucson) 'Joan Mur^hyf Science Refer'ence Librarian 

James P, McCormack> Dept. of Electrical 
* Engineering . 



Oregon State University 



St. Olaf CoHege 



Johns Hopkins University 



SUNY, Pottsdam 



Wothy Fuller, Dept. ,qf English 

Robert E. Lawrence^ Head of Science dr\d " 

Technology Division 
. Kerr Library 

Leo Parks Dept. of Microbiology 

Katherine I^ttsolk, Ref erence/ILL Librarian 

Marland Madson, Biology Dept. 

Lucie H. Ceckler, Science Reference Libraria 

Warner E. Love, Biophysics Dept. 

Jfeanne Dtttmar,^eference J-ibrarian 
(Participating ±n the workshop at her 'own 
expense; not a part of the Project) 



Copies of their applications are in Appendix II. 

The Selection was based on three criteria. One^ evidence of cormnittment 
to cry the concept, but little orno actual program development. We did not 
in this initial round want persons who are not already sympathetic to the idea. 

t)n the other hand the project 'was not conceived as an opportunity for those 

*• , r 

with the advanced progr^ to discuss and modify them, of to help iwplemeVit ' 
such advanced programs in new areas of their cirriculum they had not yet 
undertaken: This first criteria eliminated three applicants. These three 
were subsqucntly asked to, supply sets of matetials which they had dWelpped.. 
cedar Crcst/Muhlet^berg and the University of Rhode Island did provld^ those 
laaterials and^they wjere incorporated into the workshop materials./^ 

^ The second criteria was' evidence In' their application of a realistic con- 
cept of vhat they wanted to ^ccoopUah, and a con^Lttaent,^ the Institution 
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to the Project. Miile this did not eliminate out-of-hand ^ny particular 

Applicant, it did permit us to raftk the applicant^, * * • . 

The thircTcriteria was not so much a criteria for the applicant es it 
'* •> ♦ 

was a goal for the Project^ Prom the very beginning we cofranitted ourselves 

% ' ' ' ' • 

to a balance in the areas of the country" represented, subject areas rep re-, 

aented, and size and type of institutions xepreaented In-'the participant 

gfqup. One other factor which entered into 'the selection process was the 

participant institutions contributions to the visibility of the Project. 
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" ^ » JI.^ ?jn6'ject Wrector J^ctivlty ^ • ' 

During late Auguet. the Project Director attended a workshop preaented 
*. by ^0SIS.^nrattend«^4 for three reasons, two/not^ directly, related to the ' 
trftUt -• to obtain- better understanding of the BIO^SIS- system . particularly^ on-line ; ' 
iearchinft, and to observe hov thfey taught the of an informatiorf source. " Th^ 
jhi^ reason, which was related to the-grant, was > observe the workshop " format and 
to get ideas on Vhat to do and not to7do in a workshop/ From this experience he 
gained a great deal of insight ' into, workshop operayons, and as a result has developed.' 

the. following list -of do's and don't 's:. * ' ^ " 

■ * -> * ' ' ' 

S . . - - 

1.- Prepare participants adequately by providirtg them vith a schedule and ' " 
a clear idea of the workshop's pyrpose and content. 

2^ Provide session^ for active participation in the conference early. • 

^ 3. -Mixicontent prI'senCegl formally ^th other types pf activities. 

A. Dp not overload sessions with dtent, partdculiirly with related • " ^ ' 
but nonessenti^ information. * ^ 

5. Allow Miple opportunity fir interaction^ * " 

6. Provide for social, occasions outside phe tegulM sessions of 

the. workshop. ■ . ■ • 

• 7.. Organize written material to bfe handed'out so it "can be followed 
easily by participants. • . • 

8. The workshop group should be small so that leaders can interact 
• . better with participants. - . b xnteracr 

9. Make sure physical suirroundings ^d ufle of audlo-vlsuaU do not 
hinder workshop ac'tlvltlts. . 



/ 



We kept all of ithls mind lij developing our workshop. 
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III. October,' 1976 Workshop , ; ^ ' * 



The objective^ for the workshop as we stated In a letter to the partld- 

pant,8t were:. - » * * . * > ' 

• ' ^ . v' ' • 

1. Your team will \>fi aware- of. the major featrites at^d pi^oblema of cofiirse^ 

\ . ' ^ ^ ' ^- * . ,r ' , 

related library instruction;. " . - ^ . 

. ^. Your team wHl be^ jEntimately .faoil^^^RH^rlh^'s pi^pgram in Biology 

V ^ as an example 't)f an intensely inte^ated £lbrary instruction program; 

3. Your; team will be aware of ^ther types and patterns of c^dtirs ^related.", 
instruction both at Earlham and elsiwSere;* ^ * " 

4. Your team will, have written a st^ement 6f the objectives for trhe > 

* ^ ./* 

* library in)§[trucCloTi component of^ the pirof assorts course;. 

5. Your team will have a ^^tten lis^fe-gDf jtaaks .and activities which 
each of you will complete in «>rder to accomplish the objectives • • ^ 

To achieve^ these objectives, we designed the workshop tflong the 

following lines* The pace .and focus s|ioul4 be divided into three areits. 

The first is primarily information transfer. He envisioned using the first 

day to supply as much background Info^maHon. and provide as much documentation 

^ possible* The second should be less^^ structured, in an interactive mode^ 

and' concerned with the partlcip^ts* project* Thlrd^ we have^also assumed 

that the interaction of the group meabers on a toclal lev^ is Important 

^fpr the success* of the^roup, and therefore ^attlciijants, should, be housed^- 

. 5- ' ^ * ^ 

together y atid spend as much time as .possible together^ vlth some of it in . 



low-key social activities* 

The first segment of the workshop consisted of a combination of formal 
presentations and role playing* . These sessions lasted from 9^00 a*m* of the 
.first day through to approxlipately 2t.45 p*m*. (see the Schedule In Appendix 
II for detaileij* Thla technique was, used ,to tota^ Immerse the pQHtlcipants 

' Mr • 



in garlham's pirogram of ^truction in biologyv , ^ 

^ ^'the accond segment of the vorjcshop was intended "^to supply i^Jfortnation 
on the variety of types bf itjstrutfcicmal act;ivi^ on library and literature 
use in un'derRradiiate science e<!ucation that are buying used^ This information 
- took three fonns^^ (1) .presentations and materials by Earlhara librarians and 
teaching faculty, (2) instruction material froia Cedar .Crest/Muhlenbepg and ' 
the University of Rhode Utani, and (3) sample materials from acrosi' the 

-Country a^^ supplied by Ptbject LOEJT* ^ . 

■ ' (: 

The third segment of the workshog^,^* on evaluation of library Inatruction 

activities/ This session consisted of a brie£. summary 'bf what EarlhanThas ' 

done, followed by critique and general^dlscussion by*" Richard Johnson of 

Earlham's Psychology Department. This was followed by an open-ended question 

and answer session. 



/ 



The text of the transcription o^f the first day's activities Is included 
in Appendix IV. • » ^ . ' 

^ Tfie fourth sSgynent of the workshop was an unstructured opportunity for 
the participants leams to discuss their program and to make s^e pla^s for 
their projects. Thi6 was follow^ In the afternoon af^fee second day by a 
"fish'bowl'^ situation in which the team presented a description to Torn Kirk 
and Jerry Woolpy of whaf%hey planned to do'. The rest of the -participants 
observed the descriptipn and the interiaction aaongst the two of us, and 
then entered the discussion-. • 

^ . : ' ■ ' 0 

The schedule of the workshop was allowed to remain flexible. While the 
original plan had been to have the teams discuss. Cheir projects with Jerry 
Woolpy and Tom Kirk privately, and then to piresent it to "the group, the. 
participarits asked to combine the activities .into the "lEish'-bow*;^" session. 
This freed- the laat half day of the workshop and permitted participants to 
Visit classed, and talk with aoaa of Barlhaa'a faculty^ 
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■ ' . " '. ' 

The woFrkshop.- was evaluated in .four ways, , ^ t ^ . 

(1) The workshop participants cbmplfeted an evaluation form which is included 
In Apijehdix V along with the suamary results. This summary speaks for itself. 
The participants as they left Earlhao on October 22, were enthusiastic, felt 
th,eir,time had been well apent, and" that their physical needs had been luore 
than adequately satisfied. Troo their perspectiye, on October 22, there is 
very little we can 'do to improve the workshop. 

(2) The Project consultants, Jerry Bakker and Stfephen Nelson-, provided written*^ 
observations on the workshop which are Included in A^Jpendlx VI. Stephen's report 
is a more lengthy report because he was asked, as an outsider^ to give us a full 
review and evaluation of what we had don?. Jerry's comments-, although more 
cryptic, confiriD many of. Stephen's arid the Project director's observa'tions. 

In additian to- Jerry Bakker 's written coinaents, he participated in a one-hour 
post-mortem sesfion with Jerry W^olpy and the Project Director. The Project 
Director has synthesized the vaiAous coBsoents. in the following stJitement. ' 

1. Much of the success of the workshop can be attributed to the 
structure which allowed for social interaction' to occur, and more . 
importantly to the fact that the persCnallty "fit" of the parti d- 
pants allowed then quickly to become a cooperative, congenial groupi 

) This aspect is impossible, to take Into account in the selectidn 

process unless a more elaborate applicant systea is^used; a step 
we, do. not anticlpaa^ taking; ' • ■ 

2. The flexibility in scheduling should remain. The ability to change , 
the schedule in t^e later portion was important 4o the participants'' { 

* .sense that they were getting what they wanted o^Jt of the workshop.; ' ' 

3. ^rtheroore, the basic schedule design yas ai^roprlate Kid will be • 
♦ continued. Howevtr, two modificationa will be »ade* (1) The session 

other prograaa (segnent 4) ihould haveleyer speakers and should 
O^ - ' co^« in more detail the prograas 'presented. (2) The di«cu88i<m of 

15*- 
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'V- ^^^^?*'^^<^^P*"^8* propped pro^ama shoulJl^ longer;". '/ ^ 

^ Partfdp^ante .should be .asked to prepare a written statement of- thellr 
V^^^P®^^^ prograa'objec'tljvfes,** and what tasks each teas member is" going 

■ . * to have to cdtupletej • » , . , ' *■ 

■','« -I ■ ■ 

.Some" practical aspects o| the workshops that rteed changitig: , 
\^ ^^)^'P^rtict^mtB^ sleeping quarters should. be closer to the cacipus; 
^ (b^4feeting room size is a little too small; 

. (cj Package of workshop materials should be assembled, indexed and 

A . '. ' 

• ' distributed at the beginning, of the vorksjiop, rather than handed 

* - out piec.fr by pie^e. " 
(3) At the May follow-up workshoprthe participants weife divided into discussion 
groups of four each, one group with Jerry Bakker and one with Stephen Ifelson. ' 
Each^ group was to answer three questions: * Iff " « 

A. ^iven your recent experitoce, how should the Fall 
WorJcshop be i>evised? 
, . ' . % ! 

p; ^ List the problems Of inlpltoentin^ your prograia which * 
I ^ - you did .not anticipate. ) 

J,. -»* ' » * 

C.,.- List the problems of implemetitatiott^;^i^di seem coanon to 
more than one of the institutionsj^ 

Th^ answers* to these questions are included in Appendix VII. To sucaaarize 

^the content those 'angers the following ^)oints should be made, 

A> 1. The. group 'remains enthusiastic about^ the workshop, 

the project and their participation. Participants ^ 
^ . emphasized two elements of the workshop as important: 
, , r (1) overall desigh and (2) small size of. group. * / 

♦ * * ^ 
2. The nonscience coverage was interesting but not critical. 

•' 3, Heed*for cwrc details on "how-to-do-it". This is 

particularly^truc for. the evaluation of their project. 



r 
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1. Coordination bettf^i^' the instructor and librarian. 

2, The Earlhaa jaodel raised expectations too high. * 
C; 1. Difficulty in* getting other faculty interested. 

• 2, Physical -problems of preparing large nuaberji of handouts, 

Ox ' - • ■ ' 

ER^C^ , • . 3. Uttle ffcognltion of preparation tlae needed. 



r 



(4) -fhe WorltsHop was indirfictljr evaluated through the .evaluation of tbe 
four project reports by the Project Director.' This evaliiation is iijclu<red 
Iatei5. in this report Va Section VI Project descriptions and evaluations. 
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, • IV. Interia Period October, 19576 to $977 

When the overall design of the project was changed we recognlked that 
the ptcjject would have a problea df maintaining contact with the particrfSHts 
while they were developing their prograa and" iBplesenting it.- In order to 
Bainjain .the contact, the Project Director sade several contacts by letter 
and telephone encouraging the participants, off ering, suggestions and 
t generally eaSting hiisself available to the participants for «>n8ultation. 

. - Vej^ early in this period we sent the participants the tentative schedule' 

, r ' ■ ' ' - 

for the Hay workshop and guideUnes for the content of their reports 
(Appendix VIII). We also requested brief int>rin reports in late Karch 

<^or early April. 
t y " ^ 

On the whole I think the contacts had little i^act on the developcent 

^ of the projects. The contacts were infrequent and often untieely. On the 

^ther. hand the regular contact was goo<^'for sain tainins winter est and keeping 

the par^cip^ts focused on their tasks. We would Uke in the future to 

f ' ' ' 

develop procedures for helping participants with the actual developaent of 

■ • / 
their prograa. 
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V4 Hay, 1977 Workshop t 
The May, 1977 Workshop had as Its purpose the cooBunl cation by the 
participant te^ of what they h^d done to the Project 'Director and to each. ' 
other. (The schedule for the workshop is in Appendix IX.) Cpon the arrival 
of the parUcipants they subaitted thai? written re|>ort8. These reports were 
checked and the cost relevant portions duplicated so all workshop participants 
could have copies. Copies of these excerpts are included In Appendix X, aild 
sursarlz4d later in the report (Section' VI Psoject Descriptions and Evaluations). 
Following sooe f ice to read the reports,, each " teas was allotted one ho^ir during 
which they could oraUy suppleaeiit but susaarlre their written report and 
answer qtiestlons. At the end of the day the participants were asked to <^lete 
an Inve^ory of Key People" fore Uppendlx ix)#and to Ifiviaa Vinto discussion 
groups \o evaloa.te the project. This evaluation isiils^s^' earlier in this 
report. ^ 

During the initial sessions the participants' opening coeeents' were not 
helpful in elabe^raplng on their written reports. Host of each hour consisted 
of a question and anever dialogue aaong Jetry Woolpy an* To» Kirk. Gradually 
as each hour progressed", greater involvesent on the parX-^ the rest of the 
participants octairred. 
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Participants* Projects and Evaluation 



Below is « suEoary of eacW project. Each includes the following -par^i/ 

(1) description of the teaa and the participating institution; (2) description 

of the^ project, what it was to accoBpli^trf (3) what was done bet^^een October. 

r 

1976 and Hay, 1977 for the project; (4) the Project Director's asseffsiaent of 
the status of the teaa's work; fnd- <5) generaliz'ations and other points 
applicable ^ other program. (Sevetal 'of the points were aadc repeatedly 
but* are only listed under one institution. These points are starred.) y \ ) 
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I. Oregon State UfYiveraity (Corvallls^^ Oref.on/ 

(1) Description of the tean and the -lufttl tution * 
Robert E. Lawreftc^v . ' • 

Head, Science/Tfechnology Division^ *Kcr« Library 

t * . ' i ♦ 

Leo Parks • • ' * 

* Professor, Dept. of Microbiology * 

' ^ •'Oregon State Unlveraltv, a coeducational ptate institution, Is a land- 

grant aftd sea-grant -college. Programs ere offer.ed leading to bachelor*^ 
'degrees, in the Schools^ of HunsanltieB and Social Science, Agriculture,. 
Business Technology^ Education, Englneejrlng/ Forestry, Kore Fconomics, 
Pharnacy, and Science and in the Division of Health andVhvslcal Educa- ' 
tion. ' . EnroUttent: Fall 1970: 15,507. Undergradua.te 13,203; Crnduate 
* * 2,250. Library: 6A3,189 volumes; 6,328 cu'iTrent periodicals; 11,089 

nicrofilra reels; 320,921 other units of rnicrotext; 2^828 discs. 
..110,189 volures added,, $1,^74,000 spent on books and periodicals 
^ 1967-68 - 1970--)l, Schoo^ of Science : Departrrents and Teaching Staff , ^ 
; 1970-71: Atmospheric sclTmces professors 1, .associate professors 2, 

assistant professors 3, instructors 0, additional part-tine O;.blo- 
chenistry and bic^physics 6,3,4,0,0; botany 13,7,3,2,0; chemistry 15, 
7,5,0,7; entonK)l.gy 10,3,2,0,0; general science 2,6,7,2,3; geography 
3,0,2,0,0; geology 2,5,4,0,1; mathematics 16, 8, 13,'?, 3^ nicroblology 
^ 6,1,2,1,0; oceanography 10,8,18^4,0; phyaics 5,9,5,0,0; statistics 
6,2,8,1,0; zoology^, 8, 2, 6, 3, Total: 281.' Hen full time 254,* part 
tlnie 13; w5men fuil time 9, part time 4. Degrees held: 245 doctorates, 
23 master's,. 13 bachelors. Enrollment; Fall 1970: 3,032, Undergraduate 
?i213r graduate 807. —American Colleyes and Universities , 10th 
ed. Washington D.C., American Council on Education., pp. 1304-7, 



(2) Desc/ription of their project; what it was to .accomplish 

Application stnter-ent : 

(A) Freshjran Orientation: Intjoductot^ lecture survey of micro- 
blqlog^• with enphasis on i/roblems and research objectives; 

(B) / Advanced General Hicrobloiogy: Intermediate course^ emphasizing 

general methods and specific techniques 6f microbiology J 

(C) Advanced Microbial Physiology: Highly technical course empha- 
sizing the lateat research and rievelbpment techniques, 

* 

' , ^ Pflttlcipants' statement in October, 1976 : 

During Winter quarter .(January-March, 1977) plan to work with 
8-10 students in an advanced microbiology seminar. Instruction 
will consffft pf: Guided exercise (mo'dified Version of Eorlharo's); 
Guided exercise on Chemical Abstracts . ^Students will be writing 
aeveralv papers, and wlH.have a final exam that asks them to 
^. up-date a review article that is several years old. 
(B) During Spring quarter (Marc-h-Hay, 1977) plan, to work with same 

group on government documents. 4- 
^ (C) During Fall quarter (September, 1978) voluntary program for about 

70 freshmen students, ^ ^ 

(D) Evaluation of their work will be subjective analysis by professdr 
and librarian, ! - . ' ^ 
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Orcgdn State, XJi^^versity, con*t., 

(3)' What th'e participants actually 4id 

' (A) They followed their plan ^listed above in their October 1976 

statement with few exceptions which included: (i) the addition of 
a student evaluation questionnaire; 'and (ii) use of three slide- 
tape .programs (of their own creation) on Biologi<^al Abstracts > 
Chemical Abstracts ^ and Science Citation Index , 

(B) In addition to their project V target courses, Robert Lawrence 
(librarian) wap. involved in a seminar class in the Department of 
Pishferies and Wildlife, a special honors program, and gav#-ertlence 
bibliography lectures 1© a separate course />n library use offered ^ 
under the University's Council on Library Resources Grant. 

(C) Robert Lawrence attended Dr^ Joe DeSalvo's NSF Chautauqua Short 
Couraeon use of "computerized bibliographic data, bases in under- 

, graduaj|fe science '-education; 

(*) Project pirector's assessment of the status of the tean's work 

(A) Robert Lawrence fs a comaited librarian. His biggeat problem 

will be to get additional ataff or involve present st^f f in the ^ 
instruction effort. He was not fully prepared for the tltie 
, commitment involved. He is pushing for a half-time eciucation 
coordinator for the Science/Technology. Division of the library. 
As long as he remains at O.S.U. they will have some form of 
Instructional program,^ but it is difficult to see it becoming 
comprehensive for the *science8 in less than five years, and then 
only if he geta hclpT 

(B) Leo Parks came to the project skeptical of the potential contri- 

' bution of the library to his work. He left the October 1976 work- 
shop convinced of 'the ppasibilltf es, and excited about trying 
something. It is not clear from the written repqrts exactly 
how he participated in the Instructipn except as professor of 
the course, and the generator of the cfyastions on which students 
worked. The oral report this Spring, 1977, indicates he remained' 
enthusiastic about the activity. It is my judgmen^ lie will' continue 
^ to involve the library in his upper class coursea*^^ 
(C; The intensification of the library *s involvement in the Micro- ^ 
biology Department '"s cou^tsea will dep'end on the succeas of the 
library's contclbution in the Fall of 1978. I see this effort 
as Important because it will have an Impact on other faculty -in 
^ the department.. In addition, because of their sequential^ curriculum 

X,^^^^^^ a successful prdgran at the beginning level can lead to twxre 

sophisticated use In later courses without having to do all, the 
instruction in one coursi^ -as wais done In the advanced microbiology 
seminar this year.. . 'X 
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Oregon State University, con*t. . 



(5) Generalizations' and ^tljer^oints learned; from this project which are 

applicable ^o otKef p<o^afl(a . . * 

(A)^ One 8l thg'most important objectives of* an 'instructional program 
is to get students over their .unwillingness to ask librariaria 
^for ,Jielp. ^ ^ • ' ^ ' 

<B>~,^er^ is the potential for c o pyr ight p ro blems vh tcn-liBrarlans. 
will haVe to- face in using sample pages from reference tools in 
their handouts. Some national, group should jindertake negotiations'* 
to .eliminate thes^ problems 
*(C) In teaching proc^pes or technique oriented skilU, (i^'§.\ library y\> 
. us^) mibject, content relatedness is important £o effective learning 
of those^ skills. ^ 
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!!• tnlversity of Arizona (Tucson^ Arizona) 

(1) Description of the team and tl>' institution 
Joan Murphy 

Science Refei?j|nce Librarian 
Jameis McCormick • 

Adjunct Professor, Dept. of Elertrical Enr 



»ering 



Dorothy Fuller 
Lecturer, Dept/ of English 

University of Arizona is a* ct 
prAnt college offering undergr 
Agriculture (iT\cluding* School -o» 
Business and Public Administrnt' , 
iijg -School of Library Science), 
School of Music) Mipes, Nursir 
1970: ^ 2A,877. Undergraduate J 
•1,16A,83A' volumes; 12,7D0 curre- ' 
reels; 200,000 other \jnits of ©f 
volumes kidded, $1,878,710 spent 
1970-71. Holdings include Arizor 
scripts, original source material 
thropolpgy, geology, Spanish and .1 
studies, astronomy,^ opt^^al scienc 
ments and Teaching Staff, 1970-71 
ing professors 18, associate prof- 
instructors 1, additional part-ti- 
electfrical engineering lA,6,3^0,a; 
syst^ engineering 7,3,2,0,1, Tr' 
time 5* Degrees held: 65 dcctora* 
Enrollment: Fall 1970: 1,A10, Un^ 
Colleges and Universities > 10th • 
on' Education* pp. 1A2-1A5* 




*onal s 
e progr 
me Economic 
Eatth Scip 
ineering, 7' 
'nd Pharmacy 
'3; Graduate 
'»riodicdl9 ^ 
^xt; 12,50^ 
^oks and p' 
*d Western ' 
ollectionf 
n American 
N College r 
erospace p 
rs 3, assj 
'; qivil er 
*clear engl 
': 89 men; 
, 19 maste^ 
Hradua^e 1, ' 
Washington 



diversity and land- 
'the Colleges of 

Architecture, 
n, Rduc/ttion (includ- 
- Arts dt^cluding 
Enrollment: Fall 

Library: 
»00n microfilm 
^Bcs* 192,^520 
odicals 1967-68 
tory books, manu- 
agriculture, anr 
^teratare. Oriental 
' ngineering : Depart- 
mechanical engineer- 
'>nt professors T, 
Hearing 11,6,1,1,0; 
• ering 3,2,2,0,2; ^ 
11 time 8A, part 
, 5 bachelor *8» 
\ —American 
^\C,, American Council 



(2) Description of their project; •^•-f it was to accomplish 



Application statement : 

. Library and literature ir 
writing course which is « 
, Department to four * se^ 
' be expanding this" course 



* ruction will be designed for a technical 
''>red every semp-'ter by the English 
***ns of. students Next year we shall 
include specia* sections in engineering 



writing. This course will h6 designed to involve intensive use 
of the resources and staf? of the Science LIJbr«ry. 

* 

Participants* statement in October, 1976 : 

In 'James .McCormick's freshman level engineering courses ♦ 
Library. InstnictJon in conjunction wl^h a paptr. 
(B) In Dorothy Fuller^s technical writing course* A unit on 
literature search technique in conjunction with the produc- 
tion of a paper, ' For this m one hour presentation, and a 
bibliography of^ources are envisioned • 
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University of Arirona, co^'t. 




(2) con't. . 

(C) After 1976-77.' \The development of a tso'term English recfuire- 
oent;, and the itrmlemeptation of a three level library instruction 
program. This'iffll include the re-Institution of a research'- 
paper at the ^^^^'^ freshmaft yedr/beginxiing of sophomore year. 

WhaTwas dVnl bltv^een 

(A) A structured and /ormalized program was developed "by Dorothy 
Pullet and Joan Kurphy for the technical writing class. 
This included a. one hour prekentation on science reference 
sources, an extensive bibliography of reference sources, and, 

• voluirteer intervl^d with the librarian, Joan Murphy* Stu- 
dents' preliminaty bibliographies and introductions to the 
reports wfere graded before students compler&d their final 
^reports. Students were also required to compile a list of 
the library tools, they used in gathering the bibliographies— 
both the preliminary and .final ones^^ The professor and , 
librarian both spent considerable time working with students. 

(B) Instruction for Dr. HcCormlck^s class was given in the form 
of an oral, in-class presentation accompanied by three brief 
bibliographies. This pres^tatlon was given by a tibrarian 
not part of the proje^. /In the Fall^semester students had ^ 
several' options for term ptrojects, on^ of which was a library 
research problem. During the Winter^ semester, after the October 
workshop, all students were required to do a -library-based 
research paper. 

(C) For evaluation Dorothy Fuller used a comparison of the pre- 
liminary bibliographies and the final bibliographies, and the 
two accompanying lists ol reference tools. She also called 
for a written student evaluation- of the library program in 
the course. - ' 

(D) Dr. Mccormick's- cvaluattpn wae a Subjective .one done by the 
• - professor. % 

(4) Project Director's assessment of the it^txie of the team's work 



t 



(A) Joan Murphy is 'a pleasant, capable librarian. She is anxious 
• to do a good job and is'thereforfS- 0K}rou^ and careful in her 
work. She was, at the beginning the- Project, relatively 
new to library instruction activities'. Therefore her effort 
this year was unsophisrlcated. However ^ she has learned a . 
great deal about the pedagogy^ of library instruction and' has 
developed the self feonflden)|e to proceed. She will work 
well with faculty as' they. tOtn to tht library for help In 
the developnent orf course-related library segments for their 



courses . 



II. University of Arizona, con*t. 

y - ' 

(B^ Dr. McCortnlck &nd Dorothy* Puller ^'remain enthu8l^»ii<r about • ^ 
library Inptructlon in their courses, Furtherfnore they are 
crucial to the development of the program in. engineering. If ' 
Dorothy can convince several other English faculty of the 
importance and value of library instruction, it is likely 
^ that a Ilbr^ry^ihstructlon progfram will be- Included in the 

, " engineering >frltlng course, , Dr, McCoxrolck has the pot6iitlaL 

for influencing*the ScWol of " Engineering faculty. They have 
projected a multi-level program within t^ie engineering curricu- 
lum. If his enthusiasm can be coifipllme'hted wit^ careful 
planning and qualify 'response from the library, the engineering 
V *" department will develop a succesl^ful program. 

(5) Generalizations and other points learned from this project which are 
applicable to other programs ^ » * 

^ *(A) Follow-up of formal Instruction is needed, 

% *(B) Instruction can be nwre effective if It l:oropllments the 

previous experiences of students. Therefore mechanisms 
• which sort students out into similar grotips and are followed 

up with' instruction aimed at the particular groups will be . 

more successful. . 

(C) The choice of the student *s library task is critical to the 
quality of the educational experience. However, it is not 
clear what the essential characteristics of an appropriate 
task is. It has been suggested that a question to be answ^ed 
rather than a general topic to be explored Ir better. Further- 
more, the task should engage the stutlent in the material 
(-information); the task should not permit th^ sttident to 

be passive. ^ 

(D) Library instruction docs not save time; it may imthrove 
quality of library ua?fe; it certainly Intensifies library 



111, Johns Hbpkijit University (Baltimore, Maryland) \ 

(1) Description of t^e team and the Institution - * ^ 

Lucie Geckler , * 

' Sciet^e Reference Librarian . ^ ' 

# Warner Love * - , 

Professor, Biophysics Department 

^ Johns Hopkins Uifiversity is a private coeducational jiniversity. The 
Faculty of Arts and Sciences- and the Evening College, both on the 
Homewood campus, offer undergraduate and graduate programs. Enroll- 
ment: F^ll 1970: 9^79. Undergraduate A, 113; graduate 3,262.. Library: 
1,985,075 volumeai 1A,170 current periodicals; 12,663 microfilm reels; 
491,374 other {inlts of microtext; 155 tapes or cassettes; 3,900 discs. 
' ' .,■'113,014 volumes added, $1,241,162 spent on books and periodicals 1967- 
- ^ 68 - 1970-71. Special collections: William H. Welch t^edlcsl , Library;' 
* library of School of Advanced International Studies; U.S. gcwemment ' ' 
and UN document^;. Tudor ajid Stuart Club coljedtiona of 17th-century ^ 
literature; Hutzler collection of economic classics; Birney slavery " 
-collection; Leonard'L. Mackall collection; Strpusfe rabbinical library; 
Loewenberg collection of modern f;erman drama; ColliJt'z collection on 
linguistics; Couet collection of French drama; McCoy art collection; 
Hoffman collection of Bibles; Fowler collection of architectorel-^lassics; 
Ottensen Icelandic -collection; Hauer Oriental colljgptlon; Havens 
^Southey collection; Vincent collection on Swiss history;- John Work 
Garrett, collection of early Maryland items and the history of art 
(36,000 volumes); ICent Currie collection on book arts; manuscripts of 
Sidney Unier, Francis Lieber, D. C. Gilman, John Banister Tabb, 
Edward Lucas White; John Work Garrett Library, on its own grounds near 
Homewood, housing rare books and other collections. Paculty of Arts 
and Sciences: Departments and Teaching Staff, 1970-71: Biology pro-^ 
feasors 12,- associate professors 4, assistant professors 8, ins'truc'tfts ^ 
0, additional prfrt-tiime 7; biophysics 5,2,0,0,2; chemistry 11,4,6,0,1;, J 
classics 4,1,0,0,0; computer science 3,2,4,1,4; earth and planetary 
science 10,6,3,0,0; education 5,0, "4 ,0,0; 'electrical engineering 5,8,4,0,1; 
English. 9,0, 3,0,0; geography and enylronme^ital engineering 6, A, 4, 0,1; 
German 2,2,2,Q,0; history 10,5,2,0,0; history pf art 3,0,2,0,0; history 
of science 2,1,1,0,0; humanistic stuHiea 3,l,0,0,O;*matheinatics 7,2,9,1,0; 
jiechanlcs 12,2,3,0,0; military scienc^ 1,0,4,0,0; Near Eastern studies. 

I, 2,2,0,2j operations ^research and industrial engineering 6,2/2,0,1; 
physical education 0,0„p.7,0; physics U,3,7,4,0; philosophy 6,5,«,0,0; 
political economy ^,2,5,0,1; political science 8,1,5,0,1; psychology 

II, 2,6,0,1; Romance lattgiiagea 4,2/^,3,1; socia,l relations '4^4,3,0,11; ' 
statistics . 3- 4, 0,0,3; writing seminars 1,>0, 0,1, 3. Total: 394/ M* 
full time 344, part time 35;^wome^ full time 10,' part time 5r Degrees 
held: 358 doctorates, 20ma8ter'sl. 12. bachelor»s, 4 professional. 
Enrolliaent: FaU 1970:. ^87» Undergraduate 2:,108; graduate 1,480. 
—American Colleges a nd UnlveraitteH . 10th ed, Washington, D.C, 

' American Council on Education, pp. 664-685 « 
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111. -Johns Hopkins .Univerflfty, con* t. . ■ , 

<2) Description of their project; what It was tp 'accompHsh 

'^ Application statemefit ; 

To provide library instruction for' the course Principles of 
Physiology. ^ 

Participa nts' statemeft£ in October. 1976 ; ^ 
■ Students will be assigned to write three short papers. For each 
- rtey are expected to base the writing^n original research in the 
^ • journal. literature. The instructional package will include: 

en annotated bibliography, mdp of the library, and science ref- 
erence area, and list of current periodicals. 

0\ What was done between October 1976 and Hay 1977 for the project' 

M^JL^'^^'ir f J^n'^e-^several lecture sesiions" of the course, Prin- 
^ . . u^V"""" ^""^ assigned three -papers as he indi- 

cated in October he w,/uld. Arrangements were mnde for the librarian 
to give a thirty minute presentation to the class during a voluntary, ' 
^ but regularly scheduled "ProbleiBs review session" held outside the 
lecture time slot. , In ^repartition for the lecture the librarian 
prepared a physiology guide to resources, and on'e-papers; "Card 

l'nd'e*°';.« "I'l" '"^^^'^'^ Headings," and "Science Citation " 
Inde^c: its Citation- Index section." ' 

Lucie cockier used a student evaluation fonn., which was supposed to 
have been turned in with the paper. However, Warner Love did not' 
require it and therefore there were few returns. 

(4) Pr^i'ject Director's assessment of the status of the team's work 

Johns Hopkins, according to Warner Love, is a verv' dompetitive place. 
, and^^the faculty generally take the position that students should not 
be spoon fed or 'have "their hands heW." Whether or tjot this is • 
true, Warner Love beli'eves it to be the case, and. this attitude Influ- ■ 
ences his reaction to library instruction. He Is billing, -earer for 
4 the library to provide instruction formally to his class. However. 

.he wanted it on 6he students'^ tloe^ not the course's (-Ms) lecture 
time. 

Lucie Geckler is'a librarian who wants, to be helpful to students. 
She has recognized students' immediate problems, and tried to respond 

' ■ iL ^T/i^ t^^ "^^^ f"lly sensitive to 

the difference between oriei^tation to a library facility and Instruction 
in the use of the literature and t% library's reference materJall! 

The experience in the project has moved these two to tjuestlon some of 
. the -assumptions they had. While >oth remain firm In their basfe ' 
disposition towards library Instruction, they, both realize there Is ' 
; more to the problem than they once thought. 
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<4) cop't, 

- T. ^ • - ' ■ ■ 1 

The continuence of this effort will depend on LucL Heckler'a 
^ aflsertiveness with the regular professor in chargeVof "Principlefl 

of Physiology", who is not Warner Love. She wllLcave to continue 
* to cope with the^acultyV attitude that studenfs must BiT\y or swi© 
based on their own inner resources or lack of resources. The 
dgelopinent of a trul^^ course-related instruction program will pro- 
blBly therefore have to exist outside or on the fringe of courses* 
And the success. will depend on the willingness of the^library staff 
to work hard with a small fraction of the students, W with little 
or, no feedback from faculty. 

(5) Generalizations and other points learned from ^his' project wljl^rh axe 
applicable to other programs - ' 

(A) It is important for the future success of a program..fpr ,the librarian 
to have feedback from the professor on student performance. 

(B) Student evaluation of programs should be required if a meaningful 
set of data is to be c'ollected. . . 

(C) The need for instruction must be clearly perceived by students. 
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IV. St'. Olaf College (Northfleld, l?inneaota) " ' 

(1) Description of the tea© and the institution 

leather ine Rottsolk . 
*Reference Librarian * 

Marland M^non " . , 

* Pfofesso:^. Biology Department 

St. Olaf .College is a private coeducational liberal arts college 
• .affiliated with-The American Lutheran Church. Programs are offered 
Ueading to^bachelor 's degrees in liberal arts, education, nursing, 
and mvsic. " The<,experltiiental Paracollege was opened in 1969. 
^-Departments and Teaching Staff, 1970-71: Aero'space studies -profes- 
, sorsl, associate professors 0, assistant professors. 2, instructors 0, 
. additional part-time 0; art 0,1, A, 0,1; biology 3,2,2,1,1; chem^lstry 

classical languages 0,1,1,0,0; econoudcs 1,0,1,2,4; educa- 
^fl 1,1, 2, 0,2;. English 0,9,3y2,3; German 0,2,2,2,2; history 3,1^3,1,2; 
geography 0,0,0,1,1; home ecdnomlcs. 0,0,1,2 J; mathematics 3, 0,3,1, A; 
-music 5,A^9,2,1B; Norwegian 1^0,1,0,1; nursing 1,3,1, A, A; philosophy 
2, 0,0, 3 ,.1; physical education 1, A, 3^ 3,1; physics 0, A, 2, 0,1; pdfttical 
- science 0,1,2,2,0; psychology 1,1,3,1,3; religion 3,3,3,0,2; Romance 
languages 1,0,2,2,4; Russian 0,0,1,0,1; sociology 1,2,2,2,1; speech ' 
, . . 3,0,1,1,0, Total: 222. Men full tine 125, part tine 30; women f«ll 
. tim? 39, part time 2f8. Degrees held: 102 doctorates, 89 master's, 
31 bachelor's. Enrollment: Fall 1970s 2,674. Undergraduate 2,630 
full time. Wbrary: 2A5,778 volumes; 94A current periodicals; 
1,559 mloroflla reels; 2,5A9 other units of oicrotext; 1 film; 2,B50 
discs. 42,159 volumes added, $236,500 spent on books and periodicals 
1967-68-1970-7;. Holdings include 132,800 items in 69& manuscript 
connections; collectlotj of Scandinavian languages and literature; 
Bible collection in himdreda of. languages. —American Colleges and 
Universities. 10th ed. Washington, DrC, American Council on Educa- 
^ tlon.. pp.* •836-837. 

(2) Description of the project; what Is was to accomplish - 

Appllcation statgaent ; • . • 

We would like to develop an integrated library and literature 
' instruction imck^ge for our blolo^jy offerings. Originally, the 
■ " main emphasis would be on the Introductory courses, one for majors, 

and one for non-majors. 

* ' ' . • - ' 

Participants' statement In October 1976 t 

Repeated, ess^tially the same thing without being more specific. 

(3> 'What was done between October 1976 and May 1977 for the project 

The teasi developed a specific set of objectives for the Introductorv 
-course sequence. This is graduated to provide for increasingly ' ' 
^ sophisticated understanding and use of libraries 'and the literature. 
, During March-Aprii, a reference librarian n<?t assodkt'ed with the project 

■ . Instruction In the use:^^e library to a genetics class of 175 

. ^ .* students, during the labop^tory periods. Ppllowlng the lecture the 

professor and librXrlan were available In the library to help students. 

* t> * ^ r\ 
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JCV.. St. Olaf Colliege, con^t. . ^ 

'(3) cori't. ^> . 

^ 'Cotrtmfttees" of students wer£ asked to review .specific types of 
/ for aaterial on a question. Keabers.of eat:h' con,- 

^ ^ !«!h"^/^'°"^"^'^ '° ^°r" ^""P" a representative 

Of each type of reference tool category. A resource person net with 
each group as they shared information. . Following this an assigned 
paper was completed by the students. . asBignea 

In addition to developing the objectives for the intrdducH^ courses 
a strrf^tegy ^or instruction has been developed. For tie Fall, 1977. 
HbJ«^i"J^!;n i^i/^^i^l^gy-specific library pre-testA (b) u^e of 
l«tu^■^T^^ H laboratory assistants;\c) class ' 

lecture ^th handouts; (d) practical use of the library in labora- 
tory period; and (e) a bibliographic essay assignment. For the 
5^ 5"' ]tl i class a unit on "evaluation of jMterials " 

•^a^Lrd ' '^"^"^ ^^11 ^« ^signed an^ 

. evaluated on the basis of content and search i^trategy. In Level Jt 

JaLrr^'^fV "/^'J'"."" °^ evaluation of library'* 

papers will be, introduced, 

A similar program, but less elaborate, will be introduced into the 
nursing prograa, 

(4) Project Director's assessment of the status of the temn's work 

^ 4 

""^"""^ °^ "^he enthusiasm and commitment of Katherine 
and Marland. However, they have deliberately been -fcautious in. the 
development of their program, as they rightly should be. Their 
program is the most intensively course-related, and Mil work with ■ 
•^Jo^irrr^! Tlt^J^ ?^ students and support personnel of. the four 
^h^v r ^ " '° "a-^h their goal . 

they will have solved some. major problems. If they fail there will 
be no hiding it; they have a great deftl to gain and l$fle.' 

There is no t,uestion that their efforts will ga forward since they. 
inH%;2TL^ °i ?l P"^"' ^^"^ Council on Library Resources 
^Al ^JrT T^ Endowment for th| Humanities. ..The Broject' Director 
will C(?ntinue to have contact wlth^ their work in -a consulting - ' ' 

: ut?n^^^^;i„ris?r:n""i:te^^' program wm not begin to be visible 

. L«r^w! ^^l^^.f^^^i^''^ genetics cemrse .this past 

year have sensitised them to the iftrobleas they face. 

l^itiTJ'T^ .V"^ this project which will be 

applicable to other programs 

Rone that a^ not already lifted above* 
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Secoad Y^ar Plans 

The second year actually began in January of 1977 when we announced 
the pifans for the second year of^ the projects The announcenent was sent 
to several journals, Urifortunately it was too late to appear in ©ost of 
then). One in yhich it did appear, Collep.e and Research Library ^Kevs , Rave 
it special attention in their "Grants" colmanr (A copy of^^the^^a;^ 
is Appendix XI,) Because the anncjuncenent could not. appear in ean/ of the 
places we wanted it^to, the decision was 'made to taail anaounceaents to each 
of the libraries of each institution of higher education in the U.S. 

As a result of these announcsients, we received 313 request^ for 
additional information. An analysis of the origin of these requests is 
below, * * ^ 

There were' 86s applications"; 

Size o^ Institution T3rpe of Institution 



Area of 


# of 


# of 


0 to 


1500- 


4000- 


over 




Graduate &. 


Under- 




Country 


Requests Appllc. 


1500 


4000 


10.000 10.000 Unt. 


DnderpTad. 


P.rad. 


call 


Hortheaae 


80 


20 


7 


7 


/ 


1 


2 


10 


10 


0 


Southeast 


95 


26 


11 


6 


2 


5 


3 


14 


12 


1 


Midwest, 


83 


23 


^ 9 


4 


, 4 


1 


4 


11 


7 


4 


West 


23 


9 


4 . 


1 


. 0 


2 


2 


4 


4 


1 


Southwest 


32 


8 


2 • 


1 


1 


2- 


2 


1 


5 


2 


Totals 


313 


86 


33 


19 , 


10 




— V 4 


40 


38 


8 


The successful applicants 


are: 




* 













, Drew University"; Madison, N*J,; Panela Snelson/Donald S.cott 
Penn Valley Coraninlty College, Kansas City, Mo.; Patricia Lorenz/Evelyn StAat 
San Jose State Oniversity, San Jose, Calif.; Cecilia Mullcn/teonard Peldaan 
Virginia Polytechnic Ipstitu^e and State University, BlacJtsburg, Va.; 

>Anatole ffcoun/Charles Hurst ' 
Albion College^ ^lbion,.Hid5.| Williao Miller/ John Parker 
^ples of the fact sheet froa their applications are in Appendix XII. 
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It is apparent fro© the nuaber of applicants thatf tWs liroject speaks 
to the felt needs of ©my^ nafty acadeoic libraries and acienc^4aculty. Because 
the project has three objectives: (1) to help other institutions develop their 
coyrse-related library aad literature use instruction progress in under^aduate 
science; (2)- to develflp<viable Bodfls of course-related library and literature 
•use instruction ^n undergraduate sci^ce educati^ other than Earlhara's; and 
(3) to diffusfe the idea and aodels in the acadeaic coeenralty; it was felt, by 
the Project Director; that, soney allowing, the Projects should sponsor a third 
workshop . ^\ 

After consultation with Dr. Carolt Ganz^'t HSF, it was decided that a second* 
workshop in the second year should be held. However, the participants will pay 
their own expenses to get to Earlhas and the project will pay for the accoisaodatla 
in RlchEond, and the costs, of the workshop, ^ese are Dodest expenses which 
should total less than $2,000. The purposes of*thls workshop will be (1) to 
^ gather additional- laodels of development. . The isajor difference will be tAt 

the project will not be providing sa^or sticul^tion through a follow-up, wrkshop 
or the paynent of^ honoraria. Therefore we have the pote^^tial to see the 
deVeloptaent of new programs where the only input frjo the project is wor^hop * 
^ • content and personal contact. And (2) t<5 test the fonaat an<f conditions as 
a possible Bodel for continuation of the workshops after the completion of this 

I 

project. The Project Pirector feels that disseaination of the project's findings, 
^ and the prorotion of the concept of course-related li^Ary and literature use 

instruction in undergraduate science education ais^h^done in thfe future . 
through regionaX workshops similar to the additional one being held' in the 
,^cond year. , * , . 



/ 



*Ball Stute University, Huncie, Indiana; 
♦ Jaiaes F. Cosies (Department of Library Service) 
Ruth B. Howes (Physics Departmeijt) / 
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Central Arizona College, Cooli^e, Arizona; 

Glen Gordon Tiller (Assistant Dlrectcr Public ServWes) 
Marion E. Cornelius (Depgrtsient of Science and Hatheaatics) 

Central College, Pella-, Iowa; 

Robin Martin (Director of. Public Serivces) 
Kenneth Tuingtra (Assistaint Pft)fessor of Biology) 

Guilford College, Greensboro, North Carolina; 

Rose Anne Sioon '(Library-Faculty Liaison Offlcef and Coordinator o'f 
professional Information Services) ^ 
Prank Keegan (Biology Departsent) 

Oniversit:^ of Richaond, JTirginla, Richnond, Virginia; 
^ Katheriiie Snith (Jtience Librarian) 

W. Allan Powell (Frof essor.of Cheiaistry and Departaent Chainaan) 

Indiana Dniversi^-Purdue University at Fort Wayne, Port Wayne, Indiana: 
Mary Lo^Ste«»rt (Assistant Reference Ubr^rian and Health Science) ^ 
Phyliss Ecknan (Aasijftant Professor of NuraW) 

• ] 
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Th« N.tioQAl Science Foundation has juat announced the fundlng^f a, 
project to help institutions of higher education develop course-related 
library instruction p^ograsa. The project involves bringing teaas (consist- 
ing of a librarian and teaching faculty aeaber) from several institution* 
together In two several day workshop/conferences which will explore the 
philosophy of course-related Ubrary instruction in undergraduate education, 
the probleos of f^leaenting such a- prograa, and possible solutions. A . 
first workshop session will be held in' cha last quarter of 1976>nd a fol- 
low-u?> briefer sesa^ion in «id-1977. Only a^ery liadted nuaber of teaas 
will be selected. To be eligible, the acAdesdc departaent wist expres^ 
eowltment to the idea of course-related library instruction ,and the facul- 
ty .eaber and librarian teaa,sm8t ^Iready be^ considering or iapleaentln? a 
pjrograa. The individual teass wist comlt theiselvea .to .attend the work- 
shop/conference and the follow-up session (expenses paid by the Project), . 
to work on th« developaent of tbair progra* including trial use, and the 
/cotrpledoo of a report on their eflforta for which a.aodest honorlw will be 
paid. This select gro^.wlU also help in the forwilation^of etrate^ea for 
.later yeaV^of the Project. Earlhaa College is noir receiving inquiries' about 
ttie project, aiid will upon request send specific InforMtl^. and a partici- 
pant application font. Contact parsont Thosaa Kirk, Scienca Ubrtufian, Box 
Earlhaii Cbllega, Richmmd, IH 47374. Deadllna iUigust 1, '1976, 
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THE DBVEWPHENT OP COURSE RELATED .LIBRARY AND LITEftATURE 

/ '.*<•- ■ • ' ' ^ • 

mS INSTRUCTION IN UNDERQRADUA.*lfe SCIEltcB PROGRAMS 

—AN NSP FUNDED PROJECT SPONSORED* BY * EABtHAM COLLEGE 

■; > /■ • ,1. • ■ . 

Introduction ; • ^ -\ 

The objective of this project is the promotion and development of the 
course-related approach yto library and literature us q .Ins true t ion in the 

fsclfences (as defined by the National. Science Foundation this includes the 

4 ' ■*■ 

quanitative social sciences). To achieve this objective the National 

-Science Foundation has awarded a two' year grant for $'50,000 to Ear lhaa "College 
so that^the following activities can be undertaken. 

The Project Director, Thomaa Ki^-Jc, Science Librarian at Eax'lhaa College,. ' 
haa been involved with teaching faculty in the sciences, particularly bio.logy,: 
in the development of library instruction wl^ich Is liiCegrated into ,9n,d is a 
fundaaental part of p^gular subject wmrse offerlng8,'v.Thi8 prograa has been- 
in effect for approximately ten years and ha« been ir^'-our j udgeaent and In 
the judgement of outside observers, an enoraoua supers (see attached biblio- 
graphy). But while tauch can be learned froa the cxpeiricnce of Barlhaa and ..' 
other institutions, each Institution, and norc partiCu'larly each departaent,- 
. must develop a progrjm which coapllments their own piiigraa and curriculuai 
This Project is an atteapt to help dejf^rtaents lnvol^d in undergraduate 
science education develop auch a prograa^ 



Project Plan ? 

The plan and timetable for the ptoject Is as follaws: ' 

r 

- August 1, 1976: Deadline for appllcatl<As. 

August llf 1976: Selectiop made of four ^alrs of librarlens and 

> ■ ■ 

teaching faculty, one pAir each from four different inttitutione for ^^ich 
, fltuaclAl .ugport will bf provided. Selection i^U be done on* the basis • 
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• of qotrthitae^ idea. of course related Instruction, and in an Effort* 

to get institutional varie^, subject variety, imd broad 'geogr^j>h,ical 
^ representation, Additio^l^pairs, who are willj^'ng to undervrlte t\ielr - 
own expenses ore welcome* If applicants are not accepted and wish to 
participate under those circumstances, th^ shouy address a letter to 
that effect to the Prbject Director upon receiving ©^letter that they 
were not accepted. This latter group will also-be limited in number..- 

October 19-22, 1976: Workshop /conference sessions at Earlhaa College. (Arrival ' 
on the l^th; sessions begin the 20th; program ends at noon on t^e 22nd.) 
The workshop /conference will cover three matters;: . - , 

1) Presentations from faculty and librarian vi.ewpoints of ^at Earlham^a 
program is; what it tries to accomplish, anf how. In addition ' , " 
alternative patterns of course related inatriiction used elsewhere 

-will be discussed. 

2) Individual discussions with each of the foui: or more teams about their - 
* programs or proposed programs in an effort to clarify tKeir ^objectives, 

and map out the general approaches. to the achievement of those objectives. 

3) A general discussion by the group, of what atlivities the second year • 
of this px;o|iosal should support. The thoughj: is that the initial ^ 
participants and the people at Barlh^ shoui^ explore together the^ways 
in which the idea of course-related library /.instrucCion can be promoted 
aj«i developed within t>oth the library and teaching professibna. The ' ^ 
activities of the aecqnd year of th^-s project will be based on these ' / 
and latp* discussions. * 

October 23-Jan. 1; 1977: Dpveloiiaent , by the participant teaas, of their ^ 

insttuctional prograas. Barlhs« people will be >hfaila'bl« for consultation 
Vim telephona and mail* 

Er|c . , . - 37 . * 



Jan* h^M^ 1977< PnrriclpnntM impirmrnt Mu*}r pri»)»r^im« nnd complete a wr'tct-n 
reftdrt on the objectlvcB op their pro^rauiH, lUvif activities i and an 
-^nseeomctiL .of thfe progrQra*8 strengths and wcakncHftcst 
Junt 8-10 |tGntative): Report (above)' ia due, WorkHhop/conference sessions 

At Bariham College. (Arrive on the Bth, sessions begin the 9ch and conclude 
it noon of the 10th, ) ' - ' 

The sessions will focus on two items; • 
1) A sharing by participants of their experiences* . - • 

?)^ Pr'v^ldpmpuc, wiph help ftom continuing education consultants, 

* 

of t plan ^foT the •econd ytar. 
Jun« 1977-Novarabtr 1978i Second yatr 4cti\mtU8 of project. 

( 

Responsibili ties i 

1^ ^ 

Responsibilities of the paryiclpa^ cs i ^ ' ' 

1) Involvement in and/or commitmene to coutfSe relatCd^ibrary instruction. 

2) Ability and willinghess to attend both vorkshopi/ conference- sessions. * 

3) Ability an^ willingness to completa insfe^uctlotf.mattrialsi use the^, 
<md rnmplcte the reports. 

4) Willingness to participate in the s6cond;y«ar activities aa developed 
by the participants. 

/ Responsibilities of participant ''s institutiona l 

3.) Provide moral and financial support (wh^re neceaaary)^ - ^ 
2) Committed to the idea of •course ralated;vLibrary and liter^tura • 
use instruction. 

ReiHionsihIllties of the Projecfc u. ' ^ . ^ 

1) ' Provida the consultant aetVlcea deacribad on the pravioua .pages 
both through the conferanca/worlcehqps and indivlduiliBad through 
mail or Celaphuue. ^ , • . ■ 

FR?r , 3s 



■ v ^- • ' •■ . • . ■ 

^ 2) Underwrite thT! trnnsportutiony arid room And board for particfpaots 

* %fhil« attending the two -wprkfthop/conrf^ ranees. ^ ' , . 
'tovlde an honoraflua for completion of .\reporttt * 

Appllcattont « 

IP HAV^HC READ WIS DESCRIPTION YOM ARE INTERESKD IN THE. PROJECT AND IN 
mm A PAWICIPAKT PLBA8B COMPLBTB THB EKCLOSBD APPLICATIOH AND RETURN , 
TO. THE PROJECT DIRECTOR BY AOCOSt I, 1976. IF .QVBSnOKS A?O0T T8E\PR0JECT 
ilKADI PLEASE CALL (DO MCTT WRITE) THB DIRECTOR 317-962-6561. (HE VIU. 
MT U AVAILAIU BSTWEEH- JULY 17 AXD 23.) 

• / 
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r«rbor, Evan Ira. 1974b< Library Instruction tiiroughout the currteu- 

hmt Rnrlliam ooUcRe pfogrosi. ' \*nr,cH |/»'>.-.162 in John Lubans, Educatiofl 
• the Library User. . R.R. >>vker, Ne)!* York. • , 

iCtnnedy, JamoB R. 1970. Integrated library inatJructjUsf;:" Library 
Journal 95 1 1450-1A53. . . ^ ^Ji-^ ' 7""^^ ^ 

lUnnidy, JoMt R. and Thoaai 0. Kirkj ami Oveffdolyn A. Weaver. 1971. 
Course-related library instruction, a cose atacfy. pf ^the English and 
Bijlo8y^dtpart»4nti at Barlhtm College* Drexol. Library Quarterly 

IClrk, Thomas 0. 1972. Kole of the library in otr investigative labor- 
atory. Pages 144-164 ia Comission on Undergraduate Educnt'ion in the 
Biological Sciences, The laboratory! a place Invastigata. CUBES. 
Washington, D.C. . ' • 

Passarelli, Anne and Mllllcent D. Abell. , 197^'. Prtarams of under- ^ 
graduate libraries *W 'probleaa t« educating library users. Pages 
115-151 in John Lubans, Educating th< library t^er. R.R. Bowkar. 
Hew York. ' ' ' *• 

Wilkinson, lilly R. 1972. Reference aervicea for undergraduate students t 
four case studies. Scatec.row Preaa, Ketuchen,^.J. 421pp. 



A. » APPLICATl6lT-^0 PARTICIPATE 

X 

"^v •-- IN EASLHAh dOLLEGB'S 



"DEVELOPMerr of course related library ^literature use INStRUCTION 
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^IH UKDERGRADUATE SCIENCE PROGRAMS" PROJECT 



r.r^Librarlan's name and poaition. 



.2. Faculty member's name and departmcnf^ 



3. Address to which correspondence should be sent. ' * * "* 



4, Phone number. 




5. For what coures (8)ypuld your course-related library and iiterature^tfiatniltlon 
• be Intended? Glvfe^ title, general discrlp^n, and average number of students 
enrolled per yearj ^ ■ " . 



6, For the librarian (complete A and B, or C). (Use ext^a sheets If necessary.) 

\ A. Have you given any library Ifetrjictlon, either course-related, Informal 
• group Instructlbn, or a separate course? Describe wfiat you have done. 
Please Include samples .pf any materials you havt« prepared^ * 



V/ 
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6« B. What do you see as the weakness (es) in ybur program? 



C, If you have not done anything in the area of library and literature uae 
instruction, state what you would like to do* Do so only in general 
terms , but inclujie your theories what course-related library and 
literature use instruction shculcj be and- do. 
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?• For the faculty 'member: (complete 'A^ and C). (Use extra sheets if necessary*) 

__/UDe8cribe what' you see as the educ^tional^enef its for your students of 
"^■^-sQurse-related library instrtiction. If you are currently involved^ 
describe what you see is^the value of such instruction to your students. 
If you are. only thinking about it^ state what you believe^ould b^ ^hc 
benefits. 



B. Describe what you believe are the contributions which your libtari' staff 
can make or are making to course-related library and literature uae*< 
instruction. 
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7. C. Describe what you believe in your role in a course-related instruction 
program. 



8. For the team: In general terms, what would you like instUtctlon In library 
and literature uae -^in the^-flt«^y aeaber'a coursets) to achieve? 



^ ' ^ - - ♦ 

■ ■ • 

9. Attach letter^' from the chairperson of th^ eeftdealc department and the librarian 
supervisor. wjfi (ihi. 8upppr?> the application. * 

■ '^ , ♦ • • 

SEND COMPLETED APPLICATION TO THE ADDRESS BELOW BY MAY 1, 1976. 

THOMAS BIRK, ■ > ... 
Box E-7iC ^ 
Earlhain College - ' 
RlchaoAd^ IN 47374 

V 
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APPLrcATION TO PARnCIPATB 
^ V IH EARLHAM COLLEGE'S 

"DBVETOPl^ OP COURSE RELATED UBRARY AHD LITERATURE USB IKSTRUCTION 
IN UNDERGRADUATE SCIENCE PROGRAMS" PROJECT 



Llljrerian'a nane and position. 

Katherine Rottsolk 
Reference/ILL Librarian 
St. Olaf College 

?«rtif>ei^«l,^ n^-imd dejwtrtnent. 

Marland Madson 
Biology Department 
St. Olaf College 

Address to which' correspondence should be sent. 

St. Olaf Colle|e ^ 
Ndrbhfield, Minnesota 55057 



For what course (s) would your course related Ubrary and literature instruction 
be intended; Give title, general description, and average nuabi^r of students 
enrolled per yearr 

We would like to develop an integrated library and literatxie inatruction 
package for our biology offerings. Ori'gtnally, the nsain enqjhasis votdd . 
be on the two int^oductpry courses, one for majors', and one for non-majors. 
See the attached she.et copied froa the college catalog. 



For the librarian (coaplete A and B,' or C). (Use. extra sheets if necessary). 
A. Have you givea any library instruction, el thei* course related, inforaal ' 

group instruction, or a separate course? Describe what you have done. 

Please Include saaples of any materials you have prepared. 
During the last few years, t^e reference librarians have worked with individual 
instructors on assigmaeots—and have taught to those asslgmaents—for 
Biology 21,22,31,51,52, and an occasional Interla course. Instruction has 
been given both in the classrooa and in the science library. We often use 
aa overhead projector showing a very sinple flow chart and rarious Index pages A 
from SCI, Biological Abstracts, and Blorese&rch Index. V T^V- 

I have included sob? of the library assignnents for the advanced courses'; 'fqf"* ' 
the beginning courses, we have geneyally Just B^lped Set up a Uterature 
search for a topic which, is th^ghoseo by the individual 8tuien$. 




B. What do you see as the weakness (^es) In your progran? . 

Our basic weakness is, as I see it, that ve have a catch-as-catch-can 
^ approach, vithout an overall objeciive or plan* Ve badly need the ^ ^ 
' Incentive to take the tiiae to decide together irtiat library expertise ' 
can be expected of a biology major, and a non^biology major in biology 
coou'ses. Then ve need to study the biology cotirse offerings together 
to see in vhich courses instruction in specific tools and methods at 
graduated Tevels of sophistication vovld be appropriate. After that, 
a librarian and the teacher of -a course nee4 to consider the course 
content to structire a mecmingful assignment. 

It is clear, too, that ve have never built on previoixs instruction — ^ 
Aether given in biology or other departments — so ve have not built on 
or reinforced previous learning. 



. If you have not done anything in the area of library and literature use 
InstnictioB state what you would like to do. Do so only in general tenas, 
but include your theories of ^bat course related library and literature 
use instruction should be and do. 
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For the faculty moaber^ (coBiplete A, B and C). (Use extra sheets if necessary.) 

A, Describe what you see as the educjatlonal benefits for your students of 

course- related library instruction. . If you are currently involved, describe 
what" you see , is the value of such instruction to your students. l£ you are 
only thin k i ng about it, state what you believe could be the benefits* 

> * 

Whether our students are biology majors or not, they should be able tp 
pursue a reasonably sophisticated search strategy ^'en, using the science 
resources of the librsury. 

Our non-oajors should Be able to find and evaluate background materials 
and information on current" topics of interest; for thea, il^e te^hing 
emphasis will be toward less technical, more interdisciplinary and genffal 
literature soxirces. 

St* Olaf graduated over 80 biology majors in 1976; approxisately 60'will 
continue their Education in graduate or professional programs. For thea, 
the ability to c?bnduct in-depth literature 9earche8 and to Judge the 
authority of the materials xmcovered is essential* r 

^ ' toward which 

or pourse, both tracks should help to develop the critical thinking >we 
hope each St, Olaf student aspires/ - \ # 



. Describe vrtiat you Relieve are the contributions which your library staff 
can make or are- saklng to cours^elat^ library ami literature ose 
instruction. * 

Each professor in the (Jepartaent is a subject area specialist; yet. we 
are teaching general courses to undergraduates • The librarians, as 
generalists", have a knowledge of both new and older libwy tools and 
a greater awareness of how to use these to best search the literatiire. 



C. Describe iihat you believe is your role in a couirse-related instruction 
prograa. 



As the biology department's library instruction coordinator, I vould see 
nor role as three- fold: 

1 ^ • • 

1) as a classroom instructor, helping to develop the program 

2) as a colleague, constit€^ng vith other teachers in biology so' they 
are advised of their students' previous library instruction and helped 
to capitalize on it in their courses, and 

3) as a co-vorker vlth the li'brariaaa, vorking tovard a prograa 
vbere St. Olaf students nay gain' the faiovledge to use yell the 
literature of the sciences and may have the opportxmity to grov 
in their use of this ability. 



SEHD COMPLETED APPLICATIOB TO THE ADDRESS BELOW BT ADCOST 1, 1976. 



THOMAS KIRK 
Box E-72 
'Earlhaa College 
tichaond, lodiana 47374 
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APPLICAnON TO PARTICIPATBv 



/ IN EARLHAM COLLEGE'S 

"DBVELOPMEHT op course related UBRARY AHD LITERATURE USB, IHSTKUCnON 
IN UNDERGRADUATE SCIENCE PROGRAKS" PROJECT 



1. Librarian's name and position. 

ROEERT E lAWRENCE 

Head, Science/Technology Division 
Kerr Librarj 

, Oregon 'state ^University, Corvallis, Oregon -97331 

2. Faculty aembePs na»e and departaent. 

LEO W. PARKS 
, Professor 

Departmerft of Kicro^iology- 

eregon State University, Corvallia, Or^on 9^391 

3. Address to which correspondence should be sent. 
Robert E Lawrence 

. Head, Science/Technology Division 
Oregon State University I 
Corvallis, Oregon 97331 



Por what couree(s) would your course related Ubrary and literature instruction 
be intended? Give title, general description, «xd average ntmber of students 
enrolled per yearr 

Freshman Orientatipn: IntEodiurtqfry iecttir« s mnr ey of microbiology Kith ecqdiaeia 
<in probleaas and research objectives^ 40 students per year# 

Advance General Microbiology: Xntenaediate cotcrse «^Aasi«ing^genor*l Mtbods azxi 
specific techniques of iaicrobiology# 70 sttdents per year# 

Advanced Microbial P^iol<^: Highly technical couree ^apHfiy^r^^ tbe Itest re- 
search and development tecbniques* 35 stiilents per year# ^ 



5. For the librarian (cosipl,ete K and B, or C). (Use extra sheets If necessary). 
A* Have you given any Ubra^ instruction^ either courfe rented, ikformal 
group iMtruction, or a separate course? Describe vhat/fou have done. 
Please include saaples of any Mterials you have p^epatede ^ 



5i _ " - , ■ .... 

A. Hare you given any library instruction, either course related, informal 
group inetruction, of a separate course? Describe what you hare done. 

For the past year, I have been coordinating and, with the assistance of other 
librarians in the Science/Technolo^ Division of the O.S.U. Libr^ay, .teaching a 
course in "Information In Science apd Technology" for science undergraduates en- 
rolled in 'the Honors College Prograia. TTtLs course n»ets one hour a week for 10 * 
weeks) and we expect to offer the course iaext year. The Honors College enrolls 
superior stiaients for a variety of "extra^ courses in addition to enrolLaant in 
a subject department. 15 to 20 students ^ake t*e course each term. approao^ 
to the class is to show wtj^ information isf necessary to students in 'science and 
how this information is acquired and drgankzed by the "O.S.U. Library and how 
this information cap be found in the libraty. Because of the variety of student 
interests, there has been no attempt to tekch'the class froa a particular subject 
viewpoint. RatJwr, the engihasis has been bn the way the librarj gathers infor- 
mation, how this inforxaation 'in organized in this librarj, an4' the student can 
find relevant information ^n he xpints it. This means that we discuss the admin- 
istrative organization of- the library, how books, and journals are requested, or- 
dered and cataloged, vrtiere librarians fiixi out about these materials, how the card 
catalog organizes information and why we need additional tools to siqjplenent the 
card catalog, how indexes and 'abstracts are put together, and the great variety 
of disciplines for which there are abstract or index journals. In addition, we 
look at three specific areas; energy, environaantal impact stiitemants, and citation 
analysis. The final class meetings are a discussion of information retrieval and 
a demonstration of the Library Inforaation Retrietel Service using a qiastlon froi^ 
one of the class members. ^ ^ 

In addition, the staff of the Scl/Tech Division regtOariy coixiucts sessions of 
one or two hours about the library ta general or on a specific subject in which 
the students are working. JJtese are usually tours or lectures and laay be given to 
classes of as many as lOO/'^E^Sents. ' For those classes which aset regularly with, 
a librafian once each tern or once each year, we hare prepared bibUografMes, 
Journal liata^ or instruction sheetrf, (sasqOes are encloeed) Generally theee 
sessions are held on an ad hoc basis. 
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B* What do you see as the weakness (es) In your program? 

First f the lOH^eek course is too general^ that iis, the material is pot related, 
tf^ any particular class or program that the students are in- at the tiinie. The re- 
levance of the course is not as apparent to the stxKlent as it should be. Th? 
course should be related to specific coixrse work going on at that peirticular time. 
Second, there is no student participation except for discussion of the topics. 
The coiurse consists of lectxu^s and tours or demonstrations.. This does not allow 
the student to participate in using the library. There is no real problem-solving; 
no opportunity for individualized help. The student is not really learning a 
skill which is >rtiat a library course shoxzld be about. The coxirse^ should be one 
in wjiich the students learn specific skills, not a general introduction to the 
library. The course shoxild be teaching students * hov to be intelligent library 
users, not 'just what is in the library. Third, there was not enough class time , 
to purstO some of the topics discussed. 




If you have not dotje anything in the area of library and lit«ature use 
instruction state what you would like to do. Do so only in general terms, 
but include your theories of what course related library and literature- 
use instruction should be and do. 



51 



/ • . / 



6. For the faculty neraber; "(complete A, B and C). (Use* extra sheets if necessary.) 

A. Describe what you see as tha. educational benefpLts fot yodr students of*" 
^ course- related library instruction. If you are currently involved, describe 
7 what you see is the value of such instruction to your students. XI you are ' 
only thinking about it, state what you believe could be the benef|f0.« 

The Microbiology Department has no current program of library instruction. 
Most of our studefit>3 do iwt know how to use resources beyond their assijoied text- 
books. They don't know >ftiat is in the library, or how to go about looking for 
relevant_iiifo_rmation. Even if they do find information, they ^ve no skill in / 
organizing and synthesizing data. It' ia very difficult to get^the^^udents ta / 
give up theiV dependence on textbooks and to adopt the critical and investigative ' 
methods of th^ experimental scientist ' 

A course-related library program will introduce the student to an increasing 
variety of resources, (basic journals, symposia and .conferences, abstracts and 
indexes, computer information retrieval, etcTj Because t^e students- will be ex- 
posed to research resources in" stages, they will gain both competence and confi- 
dende . The library component can be made more relevant to the student by focusing 

^^trUidividual student -intereSfeS^as well as assigned class work; some problems will 

/be deslgndd for small group p^bbleia-solving . 

Science students Lave to learn how to solve problems. This can be taught in 
the laboratory, but can also be .taught in the library. A student know-how 
to find data, identify >rtiat i»*felpvant, and use it to solve a problem is learning, 
on the one hand, about science, and, on the otlwr band, how-to be a scientist. A 
weU designed sequence of problem-solving ilibrary tasks related to the coursework 
will teach the student an approach which/an be applied in ot'lwr situations and 
used later independent of teacher or oy^aniaed course. Coincidentally, the student 
will develop dooiBunica'tion sfcLUsMPBliSftblj* to' hia or her in all courses. 



B. Describe what you believe are the contributions which your library staff 
can make or are making to course-related librairy and literature use 
. instruction. 

The librarian will work with the -course Instructors to help thea design useful 
library studies at different levels of student proficiency.. Every effort will be 
made to design problem-solving, tasks which are cumulative and sequential. While • 
it As the responsibility of the instructor to develop the goals for the program, 
th« librarian will provide the resources for attaing these goals. The librarian 
and>iastructor will plan together to develop the appropriate stratec^ s the *st«de»t8 
are to adopt in approaching different types of problems. The HbrMdS^bwOd 
meet with the students and introduce the role of the library in the work oftS 
. scientist. Beginning with the least experienced students be can show them how: to* 
do selected literature sefu:^bes, eaqjhaoljsing sources and techniques. As the student 
progresses, a greater rariety of aottrces and acre sophisticated techniques can bo 
taught. With the aost advanced atudwrfci, .«0Kput«r assistMl^ search astbods will 
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Describe what you believe is your role in a course-related instruction 
program. 



^i^''^®'^-'-® °^ instructor will be to provide the student with problems or con- 
flicts of data that will stinmlate the student to 'seek answers. The problems 
will ber'^Qsigned in cooperation with the librarian. Th« instructor will need to 
monitor the student's progress, ^specially with Inexperienced students, to avoid 
dead ends or highly frustrating searches. As the student progresses, the in- 
structor can stimulate a critical evaluation of the literature by examples in 
classj somo of the more advanced problema in the sequence will teach critical as 
opposed to fact-finding skills, llirough written and oral reports the student will 
be encoyrg^* to '^yplop his coasmmication skills and to brganlze his efforts in 
a productive-'manfie**? The infftructoi'^Wst provide adequate class tijos and provide 
suitable assignioonts with the cooperation of the librarian. 



SEND COMPLETED APPLICATION TO THE ADDRESS 3BL0W BY ADGOST 1, 197$. 



THOMAS KIRK 
Box E-72 
Earlhaa College 
Richaond, Indiana A7374 
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\/ APPLICATIOH TO PARTTQIPATB ^. 

' IN EARLHAM COLLEGE'S 
••DBVBLOPHEHTnOP course RBLAT2D LIBRARY AND UTBrATURE USB INSTRDCTIOlf 

IN undergeaduatb science programs" project 

1. Librarian's naae and position. 

Dr. Lucie H, Geckler Ph,D,, Science Reference Librarian 

2. Pacult^ Beaber's naae and department. 

I Dr. Warner E. Love Ph.D., Biophysics Department 

\ ' ■ ^ ■ 

3. Address to which corresporidcnce should be sent. 

Johns Hopkins Uniyersitj, Hbmevood 
3^th and Charles Street 
7 Baltimore, Maryland 21218 

/ . • ■ 

4. For what course (s) would your course related library and literature instruction • 
be intended? Give title r^generai description, and average nuaber of students , 

^ enrolled p^yearf Principles of Physiology. Inbcoduction to the fundamental 
mechanisms of the major phjtfeiological systems; circulatory, digestive, excretory, 
nervous, ijascular, endocrine, aM reproductive* Control and homeostatic mechanisms 
viU be emphasized. Occasional lectiares on Balfunc;Jions in tbe variotis systems 
vill be given by medical exp^erts. The course iS intended for non-science majorp 
^d there are no ^erequlsites. About ope-hundred students. 



5. For the librarian (coaplete A and B, or C). (Dse extra sheets if necessary). 

A. Have you given any library instruction, either course related, informal 
^ group instruction, or a separate course? Describe what you have done. 

Please include samples of any materials you hjsve prepared. 
I have given both informal group instruction and course related instruction. 
The most recexrt group instruction vas given to a groi^) of ' Biology graduate * 
students vbo were first given a physical orientation to the library with emphasi^ 
on the areas most needed by them (location and use of the card cataJ.og, serials 
catalog, inter-library loan and Science Libr&ry). X/brief explanation of the 
Library of dorigress classiification vas given with exaaples taken from Biology - 
arid Biochemistry. They irere al«o introduced to the "use of the Library of Cohgresi 
O iSubJect Headizjgs and many other relevant reference tools in the Science Hbraia^ 

ER^^ vith special earphasis on p^ yj-Of^ped febstyactst I baye alto giyen mfixay freehwao 

^•-^'^ S4 ^^^^ -1 



A. (cont^) • * * 

• tours of the library vhicii Consisted ^primarily^f ghysical orientation 
as veil 'as numerous instruction sessions to groups of staff members 
to orient them* to the Science Library, 

As to ^course related instruction, in the past three years I have 
conducted sessions for a courfee called Chemical Principles laboratory 
• /vith one-hundred stud^s (four sectionsTi Each section received 
instruction in the s jP w iu e Library involving physical orientation and/' 
brief explanations of the ^ise of relevant reference tools (lAorganic_ 
^-ntheses. Chemical Abstracts . Meafck Manual , etc). In the past year I . 
^' ziven library instructibn in tvo coxirses : Science of the Sea and 
J^al Writinf^ > ,An exploratory teOk a^d course outlines vere 
fned from the instructors, Pa-thfiader bibliographies vere then 
constructed (see attached illustrations), • 

^ . ^ . . f 

Technical Tfritin^ course the instruction *toolc place in the 
•^brary vhere physical orientation and explanation of the use. 
^Tst relevant .Vefere|ice tools vas given (especially writing 
^d varioud' 'science and technology -indexes and abstrkc^.s), 





In j^e _gour8e, Scienc^of the Sea , the lecture vag given in th. 
classroom, filiiies vere used to orient the students to the library 
and to teach them th/& use of the catalogs and ^ Oceanic Abstracts > 




What da you se^ as the veakrresaCes) In your prograaZ 

f • ' • ' 

So far) the primary weaknesses tn the program have been: l) limited contact 

vlth the course and its instructor (l should like to attend some of the lectures 

leading up to t^he library instruction period and also take time to test the 

effectiveness of the instruction in cooperation vith the course instructor). 

- 2) limited time -for the instruction itself (ve have had to csalt critical material 

, such as the general body of literature in the field); 




U^JOM have not dotie anything in the area of library and literature use 
instruction state yhat you would like to do. Do so only in general terms, 
but include your theories of what course related library and literature 
use inatruction Should be and do. 



6. For the faculty member: (complete^A^ B and C). (Use extra sheets if necessary.) 

A. Describe what you- see as the educational benefits' for your students of 
^ course- related /library instruction* If you are Currently involved, describe 
•■^ what you see is' the value of such instruction t^o your students, Xi you arc 
only thinking about it,* state what you belieVelcould be the benefits* 



In this course the students are given term papers to write on a topic of their 
own choosing so that they l e^jj^ to use tBe library and. especially to use the 
original literature in the of physiology. Coxirserrelated library 

instruction would result inlpbvledge of bibliographic tools, relevant 
literature and effective sear'ch strategies. Such instruction is applicable 
to all physiology eotirses and by application to science courses. 



f 
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Describe what you believe are the contributions which your library staff 
can make or are making to course-rented library and literature use 
instruction. ' . ^ 

The library staff can sxipply lists of useful references Ant locations in the 
library, instcinxct in the use of library tools (handbooks and encyclopedias, 
^stracts , and indexes such as Biological Abstracts and Index H^cus ) 
as well as e:qplalning^bow to get from the latter to t\^ original literature. 
They can easo acquaint the students with the general ^dy of literature, in 
the field and the various search strategies which aay be ei^loyed to locate 
information . 
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' C; Describe what you believe is yotr role in a CQUirse-related instruction 
^ prograa. ' 

htjr role in > course-related instrVfion-^jrogram is: l) to sifpply to the 
- librarian an outline of the course and any lists or 'syllabi given to t 
students. 2) to allow the librarian to listen in on the course lecture 
and labs as* she spes fit 3) to allot specific tine during the course for 
library instructix)n and U) to plan-Vl^h the librarian the objectives of 
the instruction and vsys to test vhether they have been achieved. 
In Princip les of Physiology (25.-10) the objective vill be learning to 
use the library to tap the original li$;erature, and the test of restdts 
achieved' vill be the examination of the term papers turned in. The 
assignment of the paper is a self-administered exaa on hov veil the student 
h£is learned his library expertise. 




SEND COMPLETED APPLICATIOH TO THE ADDRESS BBLCW BY ADCTST 1, 197fr. 



THOMAS KIRK j ' . • , 

Box E-72 ■ • . ■ ' • . 

EarlhfiM College ' '*v> 

Richaond, Indiana 4^374 
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APPLICATION TO PARTICIPATE 
IN EARLHAM COLLEGE'S 
DEVELOPMENT OF COURSE RELATED LIBRARY AND LITERATURE USE INSTRUCTION 
IN l/NDERGRADUATE SCIENCE PROGRAMS** PROJECT 



1. Librarian's name and position. 

Ms. Joan F. Murphy, Science Reference Librarian, 
University of Arizona Library 



2. Faculty members' name and department. 

Dr. Jame$ P. McCoraick, Departaent of Electrical Engineering, 
University of Arizona 

Ms. Dorothy Fuller, Departaent of English, 
University of Arizona 



4 



3. Address to wHich correspondence should be sent.^ 

Ms. Joan F. Murphy i 
Science Library ' ' 

University, of Arizona 
Tucson, Arizona 8572 1 



/ 4 



For what course would your course-related library and literature instruc- 
tion be intended? Give title, general description, and average number 
of students enrolled per year: 

Library and literature instruction* will be designed for a technical writ- 
ing course which is offered , every semester by the English Department to 
four or five sections of apprpxrmately twenty-fiye students each. Stu- 
dents come from a variety of majors and diverse scientific fields. Next 
year we shall be expanding this course to include special sections in 
engineering WTiting. The Engineering Department, tha English Departident, 
and the Library are cooperating together , both to modify the structure 
of the existing course and to develop the special sections in engineering 
writing. The course »will be designed to involve intensive use of the re- 
source^ and staff of the Science Library. It will also utili2e a systems 
approach for teaching technical writing which is discussed in the attached 
N.S.F. Proposal by Dr. Oames McCoraick of the Departaent of Electrical 
Engineering. 



For the librarian (complete A and B, or C). (Use extra sheets if neces- 
sary). *^ - 

A.' Have you given any librar/ instruction^ either course-related, infor- 
mal group instruction, or a separate course? Describe what you have 
done. Please inclucJ^ samples of any materials you liave prepared. 

I am interested m working closely with the Engineering and English De- , 
partments both in restructuring our present technical writing course and 
in helping design the new sections in engineering writing. I f^el I have 
the necessary background to help develop this new program. In addition 
to four years experience and a Master's in Librarianship, I hold a second 
Master's in Education from Stanford, a 3.S. in Biology which^also included 
work in chemistry and the physical sciences, and have three years teaching 
experience. Recently I have become involved in library instruction at the 
University of Arizona, giving tours of the Science Library and infdrmally , 
working with groups of students from different departments, such as the 
'^.Home Economics Department - introducing students to reference materials, 
government documents, and journals in their particular field. I am also 
in charge of giving toiirs and informal library instruction to Spanish 
.speaking patrons at the Science Library, as I speak fluent Spanish and 
spent two years at universities in Spain and Mexico. f 

Bj What do you see as the weakness in your program? 

A weakness of our program is the fact that, although we have already be- 
gun the course in technical writing, the sections in engineering writing 
are not yet in the University catalog of courses. Getting sections in 
engineering writing fonaally included in the University cttrricula will 
be an important step in our prograa. Another weakness may be the diffi- 
culty in adapting the course to students of various scientific and cul- 
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tural backgrounds. Many of our science students are fro»^ foreign coun- 
tries, especially Latin America ajid the aideast. 

<f . ■ ' • • ■■ • • ' 

- Joan Murphy 



6,. For the' faculty member: (coi^lete A,' B and C), (Use extra sheets if 

necessary). , 

A. DescTibe what you see as the educational benefits for your students 
olcourse-rplated library instiniction. If you are currently involved,* ' 
describe what you see is the value of such instruction to your stu- 
dents. If you are only thinking about^t, state what you believe 

could be the benefits. ^ 

Familiarity with the technical literature of a field gives a student the 
feeling of being knowledgeable about his planned profession and can lift 
him from mere academic accosplishsents into professional awareness of 
current developments in the area in which he will work, mien a student 
becomes comfortable wa^ the journals and literature of his profession, 
he not^only begins to T^alize what is really goingon in his area, but 
also gains a verbal awareness and skill regarding his profession. 

One problem in an undergraduate tecfinical writing course is the students' 
ignorance of the kinds of coBsaunications in which they, as professionals, 
will be involved. The library can act as a source of jeodels for a large 
variety of different" kinds of technical writing; these models can give 
students a sense of writing as a practical vehicle of comnwnicaticm rather 
than an abstract exercise that is basically academic, Furtheraore, be- 
cause i^ew undergraduates understand the research tools of the library, a 
progra^m is needed in course -related library instruction so that students 
can pake effective use of the inforaation^stored in the library. 

B. Describe what you believe are the contributions which your library 
staff can make or ai:e making to course-related library and literature 

use instruction. • ' .<t 

In the past, few teachers of technical writing have had expertise in the 
sophisticated research tool? used in scientific and technical fields. 
Thus, 'the library staff is cleaHy needed to provide^ guidance. Also, 
since library work obviously retires the s.tudents» physicaf presence * 
in the library, a program in whi^h the liixrary staff is involved will 
make library and literature use i^nstruction .ianediately available to. the 
students, \ , * ^ ^ 



^ypbr role ii 



C, Describe what you believe is ytfhr role in a cotirse-related instruc- 
tion program. 

The faculty m^er should plan writing and research assignments with the 
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purpose of allowing the student 'to become completely comfortable in his 
use of the library and familiar with the many valuable resources and 
tools which it offers him. Clearly, the. faculty member will have to make 
himself far more aware than normal of library facilities-. He must also 
xliscover methods of making his students ^eel at home in a technical library 



Dorothy Fuller 



SEND CCWPLETED APPLICATlt»N TO: 

THOMAS KIRK 
Box E-72 
Earlham College 
Richmond, Indiana 47374 



J 
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A Preliminary Proposal 
to the 

KATIONAL SCIENCE FOUNDATION 



A SYSTEMS APPROACH FOR TEACHING TECHNICAL WRITING 



■James P. McCormlck, Ph.D. 
Principal Invest I ga^r 



r 



Departront of electrical Engineering 
The University of Arizona 
Tucson, Arizona 85721 • 



\ 



(Thl8 dooment is available froa the Principal Investigator at the above address.) 
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As actunlly held 



SCaiEDUL| TOR NSF PROJECT 
Courae^telfttcd library and literature use instruction 
in undergraduate science 
October 19-22^ 1976 



Date-Tlroe 

Tueed^^^ 
Oct. 19 



6:00 p.Q. 
7:00 p.m. 
8:30 P.O. 



Vedaesday, 8:00 a.m. 
Oct. 20 

9:00 ai.B«< 



4 



Supper 

Tour of Lilly and Hlldoan Llbrariea 

♦ 

• _ 

Social hour ^'^^ 
Breakfast 

Prelininarles (Introduction) 

—Jerry Bakker • Faculty Devebjpaent 

(FPSI) 



9:45 a.Q. ThevEarlhaia Biology Frograa 
•*-Role playing 
Introduce Exercise 
Coffee break 

Participants 3/4 hour doing exercise 
Review total contents of exercise 
Introduce Library Exa© 

Participants vork ,on exaa question 

> 

Lunch 

Participants work on exas question 
Question.' and ansvtr discueslon 



10:00 a.m. 
10:15 a.m. 
11:00 a.m. 
11:15 a.m. 
11:30 a.0. 
12:15 p.©'. 

1:30 p.m. 

2:00 p.m. 

3:00' p.m. 
. 3i20 p«a« 
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Coffee bpeak , 
* 

Other programs of course-related 
library .instruction/ «t Barlhaal 

—Political Science 

-puestioh-'and answer 
—Psychology 

•-Question and answer 
— Cheaiatry 

•KJuestlon^and answer 
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Notcr • 
JKfttms Rouse 

Kirk's 

Yokefellow 

Wildaan Library! 
Tom Kirk 



15 minutes: Tom Kirk 



15 minutest To© Kirk 
15 minutes: Jerry Woolpy 

Jones House 



Wildman Library 
Woolpy/Kirk 



10 minutes: Bob Johns. 
10 minutest Evan 
10 miimtest Toa Kirk 




-2- 



Wodneodoy, A:50 p.m. 
Oct, . 20 

6:00 p.m, 
7:30 P.O. 



Examine dloplny of mntorlalo 

(InCcrvicwo with faculty and 
librarians of Earlham can 
be arranged) ^^-^ 

/ Supper 

Evaluation of library ana 5:ructlon 



Project LOEX 




Thursdayi 
Oct. 21 



Friday, 
Oct/ 22' 



--A panel discussion 
-^Question and answer 

8iOO a^ov Breakfast 

9 1 00 a.BS^ Workshop. 



1:30 p,m. 



6:00 p.ra. 
8;00 p»m. 



8:00 a.m. 
9:00 a^m. 



—Individual pairs to develop set 
of objectives and statement of 
tasks to ^re accomplished to 
achieve these objectives 



12:15 p«m. Lunch 




h-bowl. Participants present 
thcl<,^^program plans to Woolpy 
and KiH for critiqae and discussion 

Supper 

Social hour 



Breakfast 

Visit classes » interview 
' Earlhaa faculty 



Jones }Iouse 

Richard Johoaon/ 
Jerry tfoolpy/Tom Klri 
(Wlldmao Library) 



Yokefellow 



Wildman Library 



Earlham Hall, East 
Alcove 

V 

Wildman Library 



Yokefellow 
Jerry Woolpy 'a 

Yokefellow 

Partifcipants — 
Wil'dcian Library 
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!• Ear Iham College campus map. 2pp« 

2. Who! 8 who at the workshop. 2pp« 

3. Workshop schedule*. 2pp» 

A. Library handbook for Lilly Library* 2pp. • * 

5. Library handbook for Wildman Science Library. 7pp. ' 
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12. Simplified search strategy for. undergr-aSuate biology students. Ip. 

13. Library examination instruction. 2pp. 

14. Library examination questions. 9pp. 

15. Student paper that answers the library examination question. 38pp. 

16. Course-reTated instruction in psychology: Bibliography, 40pp. 

17. Course-related instruction in chemistry : library assignments. 3pp. 

18. Course-related instruction in chemistry: library exercise. 29pp. 
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22. Instruction materials. 19pp. ^ ^ " " ^ 

(f Potsdam: . - i ' ' 

13. Instruction materials. 10pp. 

«• # * ' 

ham College materials:' . ^ , 

Ik. GeneVai Biology quit and results* 5pp. ^ ^ 



25. General: Biology bibliography evaluation form, and evaluation results. 2pp, 

26. Student attitudes towards libraries and librarians: questionnaire ^ results, 2pp, 
27/ Circulation records: per volume and per student datii* - Ip, 

28. Circulatioir records: per subject data. Ip.' 

V 

29. Bound periodicals use survey results.? App. 

30. Workshop evaluation form. 2pp. 




ERJC 



67 



Documents from Barlham ColleRe*« 

NSP Sponsored Workshop on 

Course-rclated Library Instruction in 
^ Undergraduate Science Education 



ORDER FORM 

Individual documents are available at 12c/page, $1.00- minimum. 



1. 


■2pp. 


$0.24 


' 16. 40pp. 
) — — 


••$4»80 


2. 


2pp. 


$0.24 


17. 3pp.- 


$0.3i 


3. 


2pp. 
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* The 'Barlham' Biology Program y 

Overview and Introduction 

* ' ' • « 

_B/J^ER: Place 6f bibliographic instruction within the context ^bf fa- 
cirrty development. 'One, I think the use of a library is, for a teacher, 
^ , an extension of what he or she can do with students. It offers new ^ 
possibilities for teachers to lay open before students different Tcinds ^ 
ofHnfbrmatidn, It is something beyond what is available a text or 
one or two reserve readings. It' is an enlargeinant , an additional .re- 
source, either in a course or in a curriculum. That, maybe, is 
a traditional place for the library, but it is also traditionally ig- 
^ nored. It is seeir nosf signiflcag^tly at the upper levels in the curri- 
* cul\im where students are . thought to be doiffg ^ome independent work \ 
writing papers. Xhey should be able to get to the library and'use some 
of the resources of the library. I woufd like to argue that the library 
as an additional resource makes sense throughout the entire curriculum 
and therefore it is of concern for a facjalty m«faber or teacher. It is 
not just a concern for librarians, ' 

Another way in which bibliographic instruction can have some signlfi- 
car:ce'for the faculty development is that bibilographic instruction 
workshops are a way of doing something with faculty, a way of making an 
impact .on faculty, a way of providing them with a new challenge. Tne 
initial article in this (A Learned Journal ) chat, I am passing out now Is 
(this is a newsletter we send around - the litle of course is so anyone 
who gives me material for this newsletter has t chance to say that he 
has been published in ^'a learned journal") on a bibliographic iMtruc- 
Cion workshop we held last January 1976. Workshons such as the one 
described in this lead articled I think, are a challenge to faculty, and 
I think that when faculty are fkceci with a challenge, when teachers are 
actually asked to do soiiiething different, that is when you have the 
opportunity for maklnf a difference in teaching and in the professional 
iiie of the faculty member. It is also a way of bringing faculty- to- 
gether across divisional or departmental lines. The worl^hop which we 
had here last January was a very delightful ti^. A number of people 
reported saying on Friday a^emoon to themselves or their wives, *Vhy 
did I ever agree to go workshop on Saturday?" and by Saturday 

afternoon^ after they h^d been at the workshop with Evan and tWe test of 
Farbers' friends, they recognized that they had had a pleadant time with 
tneir colleagues. ' * ' * 

Finally, and I'thinkmost import{antly , Ubrary use is ji^tilEied when 
it makes a course more effecjiy^ You can do something through use of 
the library that you cannot do*by any-othc'r means. If by means of the ^ 
library a^ teacher can be a more efficient and more effective teacher for 
what 'he or she wants to^do, for what th^ course goals are, that is the 
justification for what Torn Xirk is doing, and I think that is the reason 
why all of us are bfire^ * • . ^ . 

I'm prepared to argue from my'^oife. personal experience thdt that in fact 
is true. ' Tn th^ courses £Hat I have taugUt here with 'course objectives 
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set before involvement vith the library, I*^O^e<^'a able to do ^ese 
. things more effectively by working with Tonk^^d developing materials so 
that the students ara using the library, doing better by the use of the 
library what I i^ant t\ieci to do than I could do by lecturing or giving 
other kinds of assignments ♦ - The library for me is not an add on, not 
something pice to do when you have some spare time. Library instruction 
makes m>^-^aching more efficient. 

TO^i: Are there questions you would like to put to Jerry? 

QUESTIOK: Are we going to get a more in-depth look at the way you ^ 
handle this within your own courses or will that come later? AKS. I'm 
going to do that this afternoon. 

JERRY WOOL?Y: I'd like to add ^to what Jerry has said: He talked aboyt 
faculty or course development and how the library could help accomplish 
course objectives* It seems to me that there is another dimension of 
faculty development which I know Jerry supports. To some extent faculty 
develop chemselves and improve their professional competence by conti- 
nual r<jnewal through their students* * It is one of the ways of refreshing 
7 ourselves. Let's say, for me at least, that is one of the most com- 

pelling reasons to use the library. Not only am I more effective In 
teachings biology (I'm pretty sure that's true,), but it is more interesting 
to se and 1 am learning .neurobiology all the time. \ don't have to go on ' ^ 
sabbatical in order to learri something new about biology. And since we 
teach in & fairly broad range of topics, that is, we can't afford to 
hire someone to teach only in one 'area, *we have to cover several areas, 
and, therefore, we go well beyond our trained expertise. We find that \ 
library use by our students is one of* the ways we can keep up and broaden 
our perspectives. 

QUESTION: ts there a librarian on the Teaching and Learning Committee? v 
ANSWER: There has been* 

QUESTION: But ac any rate this workshop (the Earlham library iostruc- ^ 
tion workshop described in "the attached A Learned Journal ) evolved out ' ij 
of a committQe that did not have a librarian on it? 

ANSWER: me workshop evolved. from a librarian and me sitting in the 
coffee sho? and talking one day. The Teaching ^and Learning* Cofls^it tee is 
not a key element in what is going on in Faculty Development at E&rlhaia. 
^It doesn't have that kind of responsibility or major function. . /- 

QUESTION: What did you have 'in mind that could never be achieved just 
by other means? 

' AJfSWER (Jerry Bakker): I didn't say "never". I said, could not be as , 
effective. In the second tena of organic chemistry we fociised on 
aromatic organic chemistry, -and* I warit the people not to slaply treat 
the notion of arooaticity as a concept within that. sub-specialty of 
CheaistryV ' . ^ 
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• 1 wait them to treat that not ^/ something they have to learn by de- 
finition but I want them to understand thaf this is a working principle 
withip chemistry. I want them to see tjiat there are still challenges to 
the notion. In any text, in any secondary source, the notion is so old 
that it is gray bearded, it's accepted and people act as if <here w^re 
no questions. When chemists are publishing in this area (organic che- 
mists, of course, stilj are) they know better and they aren't confused 
by what the texts say, but of course the students don't find jChis out 
until they begin to read what some of the current debates are. We have 
designed a term paper problem where the students have to put together 
conflicting reports from the literature. And that drives something home 
about the concept of aromaticity, it drives something home about che- 
mical research that no amount of talking will do. This is done in the 
second organic course which is usually taken in the sophomore or junior 
year. Thev (J6Tri>bave to wait until they are seniors to gain this kind 
of perspe^tirve, and they do it and they 'do it well. 

QUESTIO/: How many hours of library instruction do those students get?" 

ANSWER: (Jerry 3.) Probably on the order of two class hours, plus three 
va^^icing 'exerciser, and previous experience in at least one chemistry 
cour&et" and maybe one chepistry and one biology courses. Crbn) Frcra my 



ons 



perspective their experience is uneven from one student to the other* 
Because the curriculum is not ri^dly s^uential. One of the liaitati 
of the course related instruction as a way of doing things is that you 
can never be^ sur^ that every student is going through the program the 
saiie way. Tney qilss somethings and I think chemistry students in Chea 
51 (which is the number for this "course) may or may n5f have had General 
Biology, If they .have not had General Biology, they, zaay be missing some 
basic skills of bibliographic organlrstion that we don't cover because 
so much of our focus is on meeting their specific needs in the^ elenen- 
tar'y organic chemistry course. But they will have had some kinds ,of 
experiences before they case to Chem 51. Tney will then get sch»€ in- 
struction in 51. ... 

i 

QUESTION: If you were going to do this specifically looking at it fros 
Chem 51, what is the minimal* amount of library instruction you can get 
away with and still have these kids competent to go produce the kinds of 
pa^rs Jerry wan^s them to produce? I'm asking for the ainiaal. 

A.SSpR^ (Tc)m)r A student who has gone through general biology dnd then 
thcfeugh Chem 13, 1 consider that to be an optiaua. I 'a not sure wfiether 
that Is minimum or optimxim. 

QUESTION: I prefer you %ook it for the kid who didn't have Wology and 
didn't^ have Chem. You go from scratdh up to writing Jerry's paper. j 

ANSWER (Tom): Tnat's a lot o^ hours. I'm not sure what the answer is. 
I can't answer that. (Jerry' W-.) BuD he.wuld have had to have ^ken^ 
Chem 13 in order to get into this. So 6e would have had 'to have at 
least one previous course. 4 




QUESTION: Let ne put the question this way* Are you saying that by the 
ciae he finishes the library instruction in this course, this will be 
the third tiae through, so that it will not be two hours of instruction, 
but six hours of instruction, and 9 hours of walk-through? 

A^^SVi'ER (Toa) : It could be as auch as the fourth or fifth time in this 
college. 

.QUESTION; Is this coQpuleory? 

ANSWER (Ton): 51 is conpulsory for a SheEistry najor* Perhaps we could 
take a look at the total curriculun of i the college if you are interested 
an this and see where library iastruc/ion occurs* Maybe this would be^a 
^ood cine to do that. Tne collie has approximately 18 credits of 
distribution requirements • QUZSJjidp: What is a credit? AKSWER: A 
credit Is 3.3 semester hours* 

ANSWER (Tozi) : _ About half of theiX undergraduate education (36 credits^ 
is distribution requireaents • In tr^t thare ^re two English conposttion 
courses. One of those has library instruction, and everybody takers 
chat. There is a philosophy/xeLigion requirei&ent (this is the acadcsic 
stu<iy of religion or 4 basic philosophy course) and they will probably 
get instruction in one of those* There is a political science/econo^ca 
requirement, and they will probably get to use the library once there. 
There is a psychology/sociblogy requiresent, and they say, especially if 
tney get into psychology, ^11 use the library there. Then the're is a 4 
crfedit science requirecsent of which about 3/4 of ^all students cake the 
bisic biology sequence (2 courses) and they will get instruction in 2 of 
chose. The ot/ier typical courses are in geology and astronoay, and they 
will get library use there also, and there is a language requirement and 
there is no instruction there. 9 

QUESTION: You don't have an audio-visxial language lab? 

ANSWER (Too): Yes, ve do have, bnt it serves priiaariiy as' a practice - 
drill center; They do very little vith'the literature, and they don't 
do research in the literature of the language. There is a two credit 
history requirement. They do not use the library in the first tera, and 
the second tera varies; soae do and sbee do no.t. You can see the 
as&ount of exposure students are going to get through the cnrriculua. In 
possibly 8 out of the 18 they will get sooe kind^f library use and 
library discussion, ^ ' i 



QUESTION: Hov extensive is this, can you say briefly? In these varioiis 
courses? ^ 

AKSWER (Ton): In aost cases it will consist of a bibliography of the 
aajor reference tools and soae kind of presentation to the class* How 
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that's the old pattern, the established pattern, that we have used, but 
it is breaking down because we are getting more sophisticated about what 
v:e are doing • We are using alternative aSsignaents; we're working it 
more into, the course design so that when a faculty menber starts to draw 
up an assignment, the librarian is there working with the faculty oOTber 
to develop and shape the assigrcuents to include library use. In these * 
newer situations it is very difficult ^o sepa^rate library instruction 
fro2 the" course and its instruction. 



QUESTION; It really happens this way? You don't just pay lip service 
to this? . . 1 

/VKSVSR (Jerry W.) I think it really does happen this way, and one of 
the reasons I think chat it does, is that our librarians* are full citi- • 
zens. Tnat is, they are considered in terns of governance of the College 
to be Che equivalent of faculty nenbers and participate in all aspects 
of phe college. They are scxae of the sost highly respected neabers of 1 
Che co=z;unity, and I think that is one of the essential ingredients in/ 
the interchange. Vfnen we have a discussion between a faculty nenber and 
a librarian, it is really getting two faculty oesbers together. Thi^e 
isn't a distinction. It Is real give anfl take. It is not inviting 
soaeone to perfona a service in which the teacher assmaes that he has 
all the iafomatioD that he wants and 'the librarian is just going to be 
invited in to do soxething. I. think there is a great deal of respect, 
going both ways, and that aight be one of the keys of our success. 



(Toz:): Perhaps this is enough of an overview, in a sense, of raising, 
soae questions in your nind. Talking about bow students get instru?^ : 
tion, or what we do, leads to what we're cost about today. If I could 
structure the workshop in terras of its general function, I would say 
that today is delivery of imfdnaation to the participants. We are 
probably going to tell you such isore than you want to know about how one 
prograa operates. I hope you get inside it and see how it works; take 
it apart, put it back together again, and infer fros it soae of the - 
general characteristics which tend^to suggest the reasons for success. 
But while you are doing that, you ought to be tkinking about your own. 
program. As we said in the proposal, 'Vhile much can be learned froa, 
the experience of Earlhan'and other institutions, each institution, and 
i^re precisely each department sust develop a prograo which coaplessents 
tneir own prograa and' curriculusa" aptKwe reaUy oean that. But when we 
give you another snow job about our prVgraa, think in teras of how well 
we are doing what we are doing, please ^ake it^with a grain of salt. 
What were our objectives; do ^hose objectives aaka s^e in teres of 
your prograa or are they really off basef Perhaps you have other ob- 
jectives, and therefore your prOgraa should be totally different. We* 
want you to look at our prograa, be critical and think about what your 
own prograa aight look like. What little bits and pieces of information 
can you get f roa what ve are doing that will be helpful? 
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The way chat we are going to present our prograa this morning is to do a 

little role playing. We are setting you up as students at Earlhaa, you 

are freshman students coming into Earlham College, and we'd like you to , / 

forget ever'y thing you know about using libraries, m much as possible. . ^ 

Try and think back to what it might have been like to be a freshman in 

college. I vas interested in Steve Nelson's comment last night that a 

teaching faculty member, a verjrgood, teacher, said iOiat in his teaching 

he always tried to think of what it was like to be a student and not 

know the ^information. So if you could try* and put yourself in that 

position* . . 

^ JERRY: I want to say something. Well, I want to say that you are 
students in my class and Tom is the librarian and he is cosaing to class 
today, and I want to introduce him at* the -point we are ready. 

'toM: How to set this up. This is Q^urse which was, called General 
Biology and is now called Ecological Siology. It is the first cours9 in 
the biology curriculum of the college. It is a heavily enrolled 
course, it has two lecture slots a v^ek, and then everybody is assigned 
to a lab section which is taught by a full professor and a student lab 
assistant, mere are from 7 to 9 s^c^ions depending on the total number 
of studepts which will run from the lowest to the high'est e/iroll- 

Sent we have ever had, this fall which is unfortunately a very 

large number for a so called smali liberal arts wllege. O.K., tjje 
instruction, the initial part of the instruction, is done through'' the 
laboratory sections, so today you are in a three hour laboratory block, 
is a regular laboratory perio^ 1 am coming to that laboratory 

on - 
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JERRY: We have completed about two weeks of the course*, ^d y&u have 
read lOO pages or so of the text, done a couple of laboratories, gone 
outside and sampled the density and diversity o/ trees in a plot of land 
and written up a Lab report on it. You are beginning to have some 
feeling, for bioldey, but it is awfully complicated ^d the Course is 
hard, and the expectations are not all that clear. There is 'going to be 
an hour test next week and you are not even sure what is going to ^e on 
it. In the last couple of weeks I hope y6u have come to understand^ 
science as acumulative discipline, as a discipline that builds on 
itself. You have realized, or I hope you have realized, that tt is a 
se/les of generations of testable hypotheses test^ and then, interpreted with 
additional hypotheses, so there is a kind of network enterprise. 
Science proceeds by making some kind of a guess about the nature of the 
universe, then trying ^o test that guess. Now, we have 'talked about 
that network as a kincf of abstract bod^ of knowledge alsost as though ' 
it were an oral tradition, but in fact it is not an oral tradition, "it 
is a written tradition^ Mnd its basis is the library. That is, we don!t 
sicply generate hypotheses ivcm looking at <iata; we have to look at what > 
is known 'and what is thought about what is known. The archives for that 
is the library. So, i^ yo^ look'at a scientific paper you notice that 
the introduction begBxs often'with a hypothesis that. is based upon 
justification citing literature which has gone before. Let us look at a 
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scientific paper. ( At this point I would probably have one for you or 
refer you to one, and focus on t)*e introduction of this paper, and how 
it is constructed.) You s^i^j^Jxit the hypothesis is justified by pre- 
^vious literature in which you begin to see that there is a network froa 
one paper to the next' paper, to the next paper, to the next paper, to 
Che next paper. It is not a chain but a web of infomacion, and if you 
are going to participate in this enterprise you've got to tie into the 
network, which neans you've got to get into che lib^ry. Sp char is 
whac we are abouc Co do, to introduce y6u to soae techniques of getting 
into the network, of getting into the library. I think that you are 
going to find this at first tedious but perhaps one of the noet inpor- 
tant dinensions of this course, and the part of the course that seeas to 
b^ reneabered laost by people who have taken it. If it doesn't seen 
like it nakes sense, be a little bit patient, because I think you are 
going to find it extreaely powerful and I think you are going tofl^l^e it 
alrhough j/pu are going to be sad at us at 'first. S^t please L^?n to 
To=2, and then do what he says. It will take about thre^e to hours 
N and pretty soon you are going' to be glad you, did this, althfegh aaybe 
yoa von't.^ Tell ce, let se kn<Jw how you feel about it, aiwt^I will try 
to help you to be coafortable with it.- O.K. Toa. 

TOM: 'Thank you, Jerry,* che first thing I'war.t to give you is a lab 
sneet (see laboratory write up for library exercise) which indicates ^ * 
little bit about the nuts and bolts of what we are about today in labora- 
tory. I'd like you to pay particular attention to the points 1,2,3,4,5 
vhic^ are there in the middle part of the page where we have indicated 
what che objectives 'are of the instruction that we are doing this week 
in laboratory. Kow these cuay seen very slaple, by their shortness. 
Tnat is deceiving, especially because points no. 4 and 5 are quite 

. ccsplicated, and I suspett that you have never heard of those titles 
before. (If I nay step* out of^my role for just a ninute to say that I 
asked the students this fall how 51a ny of the students knew about Biolo- 
gical Abstracts aijd Science Cit^;^on Index , only oae freshman had heard 
of either, although the upperclasKaen interestingly enough who were not 

* science aajors, did know about thea. Underground of sotae kind!) As 
you can see froa the handout, and as we have announced in lecture, you 

.were supposed to go to * the bookstore and pick up ^your library packet(see 
''Q\iLded Exercises") and *I suspect that a lot of you did not go to the 
^^^^^brary and get these. I have some expra copies, here ^which X will sell * 

^^o you for *$1.25, as they do in the boolcstore. (Kow those packets would 
norsially also incluie two other things, the handbook for the Wildaan » 
Science ^ibrary which you already have, and also a copy of a biblio- 
graphy (se6 Bibliography of General Reference Sources for Biology). 

About a week froa now -^ou are going to be given a question* A qu^tion 
like: "What do, owls eat? How do you "know what they eat?" ArfSfyou're 
going to have Co go to the library and fiifd Infortaation on -f he topic. Kot 
only are you gditfg to have ta find inforaation on the topic , j^ou're - 
going to have to jdoci^nt^ftverything you say by using primary journal li- 
. terature. You say never have thojug&t arbout writing a paper of tliat type, 
but that is the central part'T)f the course In teras of relating the use 
of the library to the process of, science. We don't want to saake using , 



the library difficult while you are doing that paper because you arc- 
goinfi to be graded on the paper, on the bibliography, the content and 
the way you put together your arguments. We want to separate learning . 
to use the library from chat paper so that wheh you go into the research ' 
on tnat paper you are already familiar with using the library to a 
certain extent. So what we have done, ue have prepared for you a simu- 
lation of a research process and the Guided Exercise in your packets is 
•that simulation. It's in a programmed format which permits you Co- go 
intp the library co work through the exercise and at each point vhere you 
give an answer to a question, you get a model answer with which to com- " 
pare your answer. Actually there are three different Guided Exercises 
in three different sybject areas. The only reason for the difference in 
subjects is to spread you out in the library so you aren't all using the 
same sources. If we could turn to the first page of the exercise, there 
ig some basic background information about the topic you are^going to' be 
working on. ly question that is being asked, ahd the simulation of the 
researcn fii«-^s the focus of the exercise, is on this first page. Then 
or. the secind paj.e "is the beginning of the exercise itself. What happens 
IS that you are ^iven a stateoent which either defines terms or.gives 
some^actual information. You are given instructions* t9 do something and 
tnen you aref^asked a question. You are to attempt to answer the question. 
..".en on tne next page (in this case, page 3) in italics is a correct or \ 
nearxy correct answer to the question, and you are able to check. What ^ 
.you should do is write down your answer in the Guided Exercise. If it is 
correct, you can fcontin^e to the next part of the exercise. If it *is 
vrong, you go. back and try to figure out why it is wrong. What is the dif- 
rict^ty; What are you interpreting incorrectly? What kind of problems 
are you >feving? If you cannot figure fhat our quickly, you should come and 
asK one of the librarians for help, either ayself or one of the student re- 
rerence assistants. They'll try to help you figure ouf why you iid not get 
the ri^hc answer. 

. You start 'through phe exercise'and vork'it at your own speed. We recam- 
'nend that you not try and do the whole exercise at one tiae. It is some- • 
wnac tedious and it's conplex. As you not^ice from the cover, it is in 
.five sections. Each section is a logical unit which can be done in a time 
period of an hour to an ;hour and one-half. We 'suggest yaU do one or -two 
secticms a day throu^n the next week until you have coapleted it. Your 
assignment for this laboratory period is to complete the e-xercise, ^urn 
in your responses to, all the questions and then take a 15 minute quiz 
which covers soae of the major. points in the exercise^ There £« no 
grading for v^nis. All the* iaformation of how well you did on the quie 
and the 'answers you give to the questions, are b11 .the property of the li- 
brary. The faculty member never sees thea. The faculty member will find 
out if you did not complete th^ exercise. 

Grades on the quiz are not part of the course. The gracUng on library 
use will coae indirectly in the evaluation of the 'bibliography and the 
papers you are doing later. . (At ^^is point we would turn the- students 
•loose. Some of ^them would go to the library to wbrk on the exercise. 
Everybody can't start at the same time, and normally "peaking., students 
would do this in sequential order. We would simply t^l tbca' that Just 
because they have been left off fVoa lab (they are^y in lab about 
three quarters of an hour) doesn't mean that the lab this week is easy ' 
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or short. It simply means the time has been moved and spread out through 
out the week. But they sho61d be ready when planning the 'schedules to * 
allow 3 to 5 hours, to ddL the exercises. Kow what we'd like you to do ac' ^ 
this point is to go around '^he room and assign you to start at' different 
points in the exercise, and we will giN^e you a chajice to work o*n it/^ 
after you have had a chance to have a little coffee. I '1*1 let you work 
on it for about one-half hour to about 45 minutes. You should s5:art at 
the beginning of a section and you should work that section. That' should 
give you some flavor- as to what, is going on in the exercis^. At 11:00 we 
will come back together again and ve ^11 go through the b*lc cohtenr 
of the entire exercise (this outline fonii) so you can see wftat the total 
content is. Tnen right before lunch we will give you a library exami- 
nation question to work^on, and you are going to apply the strategy in 
the exercise to find infonaation to answer the question.) 

This is a learning experience. You're -to get as much out of it as you 
possibly can because it is going to pay off next week when you get your 
library exam fcueex ion. ' ' . * 




JERRY^i^i^-js^i^h^we giye you the questions before noon, ve are going to 
tell you CO work together, share as much information you can even 
ohough we expect you to write your own paper. 

JE^IRY W: Have respect for the books and the fact that others are sharing 
t aem. . 

TOM; Be patient when the book you want is not on the shelf, and don't- 
reshelve it. 




(The participants worked on. one section of the exarcis^e for about an 
hour. Then the group reconvened to review the entire contents of t;he 
Guided Exercise. ] 

The Content of the Guided Exercise for Locating Biological Literature. 

. . . ' ' \ 

TOM: The objeccivea- of the program are seated in'cA two page hanaouc 
Objecciyes for Library Inscraccion in Beginning Biology, and the Search 
strategy of the Guided Exercise is summarized in Figure 1, Simplified 
Strategy for Undergraduate Biology Students. - 

Section 1 of the exercise is the start-search, and covers the use of the 
McGraw Hi ll Encyclopedia pf Science and Technology and/or the text. 
Bibliography included, and Use the author approach to the card catalog 
.boxes. Section 2 covers the use of the subject approach in the card 
catalog, and that part below it, Qpes the library have relevant mate- 
rial?, and Ask phe reference librarian for help. This point is made at 
several places in the exercise. Section 3 of the -Exercise , The Review 
Serials, is off to the side on the flow chart. Sections 4 and 5 are 
Science Citattion Index and BioioRical Abstracts . I find flow charts to 
^ be useful ia some ways, but they are deceptive in others because they 
make the system seem simpler than it reaily ig. For the etudent ^t this 
level, I think the simplication is all right ,^ and I hope you will keep 
in aind that these are by and large freshman, ia their first term of 
coUege.rand they are predominately ii ii f ii j-'lfritji Those who are 
science. majors will get taore sophisticated iosttuction in upper level 
courses. This exercise would be the science equivalent to an introduc- 
tory lecture on how to use the library, except it is geared specifically 
to the science and general biology literature. 

QUESTION: Are these specific., for example, this one dealing with chromo- 
.sone mapping, gey mapping, is this tied directly to something you 
specifically do In the course? 

ANSWER: No. Ideally that would be desirable. The General Biology 
course, when it was taught as a survey course covered basic concepts in 
biology. In the first three or four weeks when theyj do >the exercise the 
area of -ecologjF i^^covered. In order to get people spread out in the ' 
library, in terms of using different tools, aftd getting them physically 
separatgd, we can't have them all in a very narrow subject area. There- 
fore, having all the exercises in ecology doesn't make sense. That's 
wny we have three exercises: genetics, ecology, and physiology/ behavior, 
rney don t relate well to tH5 subject content of the course, which they 
might ideally do. If yoU bad a small upper class course vith 30-40 
students, you could do that. If you hatf a genetics course or- micro- 
biology course, or sotae sort of engineering course, or organic chemistry 
course, you could develop assignments' specif ic to the subject matter of 
that course. ' , •' ' 

JERRY WOOLPY: One thing you've got to recc^gnize, we've been at ti»is for 
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a long time, -and this has evolved a bit. We started oqt doing all of 
this with dn oral presentation, and it worked* It just was very in- 
efficient. What I'm cautioning you against is. the ^feeling that you have 
CO have this kind of support in order to 'do the program. Tou doh't. 
You can evolve it. 

TOM: iJe^rj^as telling me this moving he waS talking to the faculty 
here l^st evening about wherl we" started, and he suggested we ^take you 
on a guided tour of the original science lilJrary faciliCLfes. The li- 
brarians did-n^t hear that, but when we started this program, we were on 
the fourth floor of the old science building, and the elevator only goes 

• • ' o°nnl!^o^!!^^'^ were ^800 squnre feet 'of floor space, roon for 

2,000-3,000 volumes, and about 20 people. • That is ail we had. We did 
it. Now, in retrospect we don't know how we dfd it. You start where you 
are and you go as your resources and your time allow. What, you^ve. seen, 
as Jerry suggested, is the result of 10 years of evolution of the enter- 
. prise. ' , ' . 

ft 

'y QUESTION: Do you feci that you^re missing a lot because you are no . 

longer making those person to person pre^ntations ^r person to class pre- 
sentations, or do yoii think this really is that much better?? - 

ANSWER; I do have direct personal contact with each lab session, just as 
I dia with you this morning, for about half an hour, when I explain how 
to use the exercise, and the philosophy of library instruction as part' 
of their* general e^lucation.* 

s 

? QUESTION: Isn't it possible to give the introduction to all of "the stu- 

dents at once? , * ' ^ 

* ♦ *- - ' - , 

ANSWER: Our method is S little inefficient, but the problea is that we 
don't want everybody ' starting in the library at the same' tiiae^ We like 
to keep the thing in a tight 'sequence because tne timing is important. ^ \ 
It doesn't do^any good for me to go in and talk about thB philosophy of 
^ using^the library three weeks before^ they get to the exercise. 



JERRY: My guei^s is that this presen|ation to a group of 25-30^ students 
that Tom makes is largely a ritual. Very little comes across at that 
tijae. It is just kind of setting the scene. He tells them a I6t of 
substantive iafomation, most of * which doesn't stick* 

TOM:* They don't believe it for one thing. ^ :\ 

JERRY: Right! They don't attend to it particularly, but it is neces- - \ 
sary that we get some introduction, and say, -"Here^s Tom Kirk." This 
works - t"his kind of thing you Just went ' through, particularly when it - . ^ 

,±8 followed up dirfectly with an assigiiment. • , . ^ 

QUESTION: ffne thing we are doing a little differently; we were br^^nging 
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cfanses into the science library and actually lay'ouD on tho table examples 
%f dictionaries, encyclopedias, indexes, handbooks, and guideS to lite- 
rature before they started, so they knew the difference between an index 
and a guide to the literature. It was just a sampling of different kinds. - 
It gave them an introduction to what the things were before they started 
looking up their pr^ojects. 

TOM: I'd be interested -in your assessment of che ability of those stu- 
dents CO follow the abstraction, that is th£xoncept of the encyclopedia, 
and Che concept of the index or abstracting service. Tne exercise deli- 
ber^ely avoids too much reference to that.v It attenpts to deal with specifi 
cools and our experience is that freshman arq not capable of thinking • ' 
about search strategy in terms of this flow chart, at this introductory 
level. Kow we do use this flow chart with the second term General 
Biaxogy course when we do advanced instruction. That is when we- 

try to introduce the ideSs of reference tool categories: encyclopedias, 
dictionaries, bibliographies, annual reviews, index and abstract mate- 
rials, and how you select the appropriate tool in that category given 
yo\ir special topic. 

WARRZN: I*have been sitting here thinking to myself^* and I nay be all 
wacky^ that you ha^e got the cart before the horse ^ that in fact, as*. 
Jerry said,- th6 fundamental infonaatioh, is the crriginal journal ^lite- 
^rature, and I rhink you are concealing this f^ct, the ^condary and 
tertiary* sources are regurgitaceH, digested. The prisie sources ar? the 
journals, and you might even tell Then what? the referee process is all 
a^^ut. rnen we- have the^e aids to accessing that information which are 
abstracts, dictionaries, handbooks, ettf. 

JERRY: Yes, we ceach them how 'to write a lab report ac the same time we 
are doing this. • We are building char together and we really' Mke che 
distinction between prinary and secondary sources, and that is very 
issport^nt in all the different sections of this course. The cart before 
the horse is a^o true. They dida't aslt-^ou, how do' I find the infor- 
oation, we tell thea, and've do a lot of that. But we are trying to get 
the question closer to the answer and, that's why we follow this up 
directly with the question.. That's why we call what we are doing an 
exaa- 



TOJf: I think one thing we dl^d not aentiqq though is subject matter 
knowledge, in other words, the students c^'t get to the literaturfe ' 
because diey don't know the subject, so they have to read the encyclo- 
pedia. ' . . . 

WARREN: Oh, sure, how you access this vast fund of "refereed knowledge is 
the problea you li-bra^ians are dealli^' with. But a scientist, T ait 
here and say, "I don't care hov^ou get to it^ but I-Hin't want # sight 
review of articles. I want an original paper, with cited orieinal 
literature.". ' ' . -s, o 



PARTICIPAOT: In oclie'r words, if you want 'a transition, the students come 
and tlioy. first hrave lectui:es .oipr a subject and those subjects, irrc about 
wliat was 4one in iihe" primary literature. It vjas researched and put i^to 
th,e primary? Iiter9t;ure, That is how it. happened, aqd then you are going 
to make a transitioD from that to how to find it. You fe^ thaV you 
^should make a psychologrically logical' transition. Is that what you are 
ta4.kijig' about? * ' \ • * ^ 

WASRr.iv:^ No,» ^it^struck me that concealing from the freshman the fact 
" tlfaTthe fun;iamQnCal prisi^ source of iaformatfo'n ^d the' information 
tjfiat^we are trying to^^trieve, that stuff is written iq refereed Jour- 
nals^ The gome Ve ar% playing is How, you get to it. 

TOM: 1 think it may have the affect of concealing it, although I don't* 

• think it comes across that way because in the assignment which Jerry is 
^oot to give you;, we do ma)ce the point that 'what^hey should be after 
is^the Journal literature- When. I -^introjduce the exercise, I ask the 

.question, "What do JraV'Q eat*^? an4 I say, you are going to have to 
defend your answer with primary literature, 'md I probably don't go on 
to say, wfiiA^iS' what you would like to hear me say, is that all .these 
other' sources are only ways to .g^tvro T>irimary liter^iture.- ^ 

LEO;' 1 think the. key ideally is to help- everyone get to th6 primary 
^yC'eratur^, ^byt I t^ii g k t hat" you simpiy, c#n*^ d\inp that on people. 

• like the ^radiW e^ptokzh. That to me is one of the reasons I waa'in^ 
terestei'-in this particular problem, bfrcause the graced apptoach will J 
work even with graduate sta4ents*^ I^^imply- cannot go iftto an area where 
the 'Students lack^familiarity and can^not read crirlcaily.^' I» think the 
important thing ^ critic^ *evdluation by the students, and I think the 
oal;^-W&y to, get there- is^ through a graded series. He has to learn to 
crawl before he c^'valk,.^ and we have seen many examples of this,' sd 
let's not be' to.i5 hung vg on. getting, the student into the Journal of 
Molecular ^lojjjr^y r l^t' aet t^rinto the^ libraQr f^rsi:. The way of 
getting 'him int^ the Journal o^f " Itol^ca p ter Siology vary jfrom st&dent^ 
to s^dent^ ideally' we want . him thereout there are Just a lot of 
scudentfi Who never get tliere. As a micrdbiologist , the' student will 
eventually get to the prljSarj^ soUrce,. bu£* if one of my students -.has 'a 
queatiort in astronomy or if he has a question on some social strience, he 
is never, going to make i^ 1:0 the priaary^ll^terature^ but.^t least I want 
him to g^t ■ through the' secondary and te^ary literature^ and i£ ye ^:an 

.show him; that iii'a,microbiol0giaal*3etti'ag I Want iiir to ie abTe^'do 
an' astronomy ox socioloftical* pfobleia/ I don\t think that our b^ect£ve 
should hk c^e refferee articles, ' 1 thtnk our objective here sr^^ld be 
whac progjin^'^can w^e develop ^o allow the ^Oudents to Use the\llbrary 
effectively in ,many dl^erent contexts*. , . . • ^ ^ 



WAiOlEN;^ I may be'takifig an e^tij^e position*, and there^ ts a point that;, 
you le^t out^ and t^at^ is the reviews: like /the' aanual reviews -^nd tl^e^ ^ 
murtivoliime series The Enzymes) are written by. experts in the . 

'ff)eld who have, aiij^d the literature and Jaave-tfoYie a lot of tl?e work ttyi 
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the student." ought not to jump over that, or around bhat or subvert 
it, but use it. ' ' 

TOM: Are there jany more ^estions about *the general objective^ on that 
two^age sheet? Jer^y is going to play his role again as*-a faculty ' 
member and give you >our library examination question, have you work on 
it SwHile before lunch, then after lunch. See if you can apply what you 
have learned; in the, exercise, and what we have also shown you in this 
summary of the Rxercise* Are' there, any more questions about the ob- 
jectives and ba^ic coverage and^ontent? 

JERRY: I think ye should keep. in mind that thid is 'a small enbugh group 
so that we can stop and go over anytKicr^, give'^and take is really more 
important t^an^the meager offerings tl\at we have for you even though we 
are pretending xhat they are highly* sigpifibant, so please stop us. 



PARTICIPAKT: -These offerings are not meager. ' 

mnc I want to reinforce wfeat Jerry h^s said. ^We ejti small enough pro-7 
gram and the kinc-s of excursions that we have had are vi^ty Important > 
avid there must be time for chat 'kijid -of thing, 

^ JERRY; First thing I am passing around is a <^yer sheet which every 

* student gets. Then, I will pa^ss ^oijnd specific questions- that will 

• only be relev^ant to^ ay section, Everybo'cly ^n the course get/tki-s cover 
. .sheet and £ attach to that a separate sheet of questions pecZliar to my 

section, mis thing was put together by the Staff of •;:he cJurse\ You 
nave spent a week on the Guided Exercise that -you just did^nd, this 'is ' 

. a week after iom came in and i^l^e that, presentation. You j!ave completed 
the Exercise, and you have taken your quiz,, and so forth.^Now^you are 
r^ady to u^e this information. ^ The seconc^page is sim^ij^to say that we ^ 
want carbon 'cppiei.4:hat ^ are going 'to turn in arid that the carbon 

> copy should not have your nais6 on it/t>0cauae we are going to pass it 
around Che class/ Students who hav^ worked on the same question ^ chat 
you iwve will re^d.your paper and make marginal coabents and grade it. 
The instructor will do this too. * a . > . . 

QUESTION: Woy/long have you -been doling that? * ^ , • v 

JERJIY: About six yi^irs.- " ' ' > 

• 4 ' . * , ' 

QUESTION:: I notice* that ^ you, onl$^ let about f oqr^ studfeots do< iti How - / 
wey.*do gpades-that the 'foiir students give correlate With the instructor ^'s? 

.'^ JERRY: ' They are consistently lower. I make the bargain with them that 
. if tbefr grades are iiigher than mine*, then I will raise the 'graA^^nd I 
have to raise about one*in twenty.- Their cctements a.re Tsuch more cfiti- 
cal than mine. That is ^hey really "g'et after each other at>^t detail, 
and many times they h^e rea:d the^ same source material. ^ 

' ' ' ' * ♦ 

QUESTION: "What Jcind of exposure- do they have to the stj^e manual'? 
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JERRY: We tell them tha^ Ic is on reserve, and they have use it, and 

as you vfill see ^in this thing I aa going to pass out, I give thesa some 

guidelines in addition to that. They do this type of exaa four tira^s, 

that is four times over a perio^ of 20 weeks, and by the time they have 

done it four tijaes, their style |s correct. The first time it is kind ^ ' 

of* messy, the^secoad time iz iSyOetter, and so on. 

<i;§M: We should sAy that viat ve are going to do is approximate the 
id^l and each tine'they'do iA better. First tdmefdt is really terrible, 
bud they .get better as they ySo otHers* 

JERm: They really dpsjand've think the repetition of this assignment 
is crucial. This is n^t something you can do once. It needs to be done 
ac least twice, and I think taore, although lay colleagues would quarrel 
with that. Now I am going to pass out to you a set of questions' from me 
to ay class and a set of questions from one of my colleagues to hiS' 
class. Both of these wcSre! atapld^ to this one that was* passed out r 
originally. First of a^l, I am passing t)ut my colleagues questions, and . 
i want yau to focus on these t^ese are actually the ones on which you 
are going tjo work. I am going to pass out mine and point out the dif-^^ 
.ference',-,. Kaw you may_^ck one ot these jfbur quest ixins—axuL wark^u ic- 
We also have the students* results, because we '^ave the papers that 
were generate^ by these quescifes. Take one, and you, ^ike I say, use 
all the resources avail$.ble to you including your fellow students and 
other Instruotors from other sections. We are fitting on fi^e same side 
of the' de^ic, in other words, are working together. Let me show you 
my vision which I think you will^see right off is quite different 
although it is the same assignment. Tnis g^<res you some idea of ^le 
.^ariation you^^can do, O.K. ,^ I 'have written some notes on them, I'ta not* 
^^ure Bill ^Harvey doesn't say the same linings in class as I have writt^h 
- out, i really wasn*t intending to'call your attention to that as much ' 
as I was the different style of questions* As-'I see it, the difference 
between my questions and Bill Harv^'s questions are that the ariswers to 
'mv^questiqas could not b^ found in a textbook. You might find an ansi^ir, but 
it would not be adequate. Tney ate frontier kinds of questions, you i 
have to go to the journal literature, and you. are not even going to find . ^ 
satisfactory answers in the journal literature, but at least you are 
going to be able to a?proxls;ate the answers. They are harder questions, ^ 1 
broader issues axid taore scientific theory^ Th,e others arl more specif Ir 
I am not sure which ones are better, but they are clfeariy^ different. 
Bill's questions could b^ answered adequately from the textbook, even , 
though he would not accept the answer xmless they used primary sources* 



TOK: There is also probably an "ans^r^*' to Bill's questior^, while the 

ans^^er to Jerry's may be more open-ended. That's because^ ^hey are 
closer ta the frontier • ' . • , 

t^USSTIOH: Suxdents do o|| out of four? 

TOM: That's right. ' " * 



JERRY; And one out of three in my section. 

QUESTION: Are youiT questions usually based on'soaething that yo^^bave 
done in your laboratory? • * ' W ' 

JERRY: Yes, that's right. ^ . / * 

QUESTION: How abouc the other questions? ^ . ^ 

JERRY: No, they might have read something about it, but the;r are not 
right out of Che reading. I aa trying to base sy questions on expe- 
rience that they have' had in lecture, reading, or something like that. 
The first question is actually fi^d cicperience. 

TOM: Maybe a, little bit of bacJigroq;id here-would be helpful. The' 
course a6 it was originally designed several years ago atteapted to work 
at getting students to put tog^ether the relationships in the process: 
question the literature, develop a hypothesis, and the experimentation, 
and then write up the. results. We have'i had long stc^ff discussions about* 
this, and about how to achieve it successfully. I think eve^body 

-agrees -that we have not dofie a successful joo% Sooe of us, I include 
ayself at this point, are not sure it 'is appropriate to try it ^ith 
freshsaq, and ethers^ I think Jerry is -one of those who thinks .we should 
keep trying. Maybe we can saTce a brea4cthrough if we keep puttir4g our 
sinA to it. Tner^ 1^ a, difference of opinion aaorig jthe staff as to how 

^weii we sight achieve tne integration of library useV hypothesis develop^ 
sent, experinental design, execution dtf the experiment, Analysis of the 
data, and write-up of the conclusions,^ Jei^ is attempting to do that, 
csore with his kind of questipn than is evident With Sill Harvey's kind 
of questions. * -"^ 

QUESTION: Both are effective. I ass not quitg sure what correlation 
there is in what you are try^^ng to do, but I hav^a q^iesti^k^ '*Whatl> 
th^ nature of the student you have at Earlh^p acadsi^ir^l^yi VnaT^a^ 
^youT admission requireaents? ' - ^ 

JERRY:' Well, I qannot give you acpual numbers.- Their SAT scores are' ^ 
siddie-ish, they are not extremely high, and scxae of them are risk 
scores, - ^ 

QUESTION? ' What are risk scores? ; 
JERRY: 300 * • * 

QUESTION: Wh^ is jaiddle-ish? ' . / 

JERRY: 1000; 450 to 500 each. • . 

QUESTION: What is the to;al7 

JERRY: Most, of pur atudents nuT in the area of 900 to ^000. 



QUESTION: V?hat fraatioa of your student body is -pre-oed? 

-JERKY: We have between 10 and 20 applfcar^ts per year, p6r class. 

QUESTION: You zaean studen^S^^^pp^lying to medical school? 

JERRY: That's right, in a/'graduitiog- class of 200-225. We have nore 
initial interest ancf of those we usually get 5 or 6 or 8 into jsedical 
school. I think we get ever/' student into nodical schbol who was quali-. 
^ fied. I have never felt that we were short changed by the-^cedical schools, 
Not to' say that I didn't think it w>uld be nice if so and so got in, but 
it is clear froa 'their record that they are not going to. If we gfet a 
student with good grades, and KCAT scores, they will .get in. I think it 
is important tdT say that our undjergraduate biology and. cheoistry pro- 
gram are not overbalanced by pre-oed students. 

WARREN: I an sorry, but we have this fantastic cutthroat c^a^etition 
aiaong sCudesnts and^ this colors the ray ?;hey go about? doing their jobs. 
They will hide- the books ia the J^H^fary, tear the pages out. ' 

?ARTICI?A:£r: That rarely happens, and iS^hen it happens, it cannot be^at- 
tri-btited to pre-fced,'' but attribute it to people who are trying to iai- 
tate the adult . systea. ^ 

JERRY: You will have a week to write a five page «say in response to 
those questions-, . any one of those tfuestions. If you are chinking about 
It, and want to try your ideas on oe» or -on anyone; else on tChe stuff, I 
think iw sight be a g6od idea* If you feel you know what you are doing, 
SO ahead and write'your paper* You probably won't be abie to find ae 
an/^ext week, but if ^ou do,' I-vill help ydu. If you con't find se, 
call s;e, as I would like to be aore helpful ichan I probably will be. 
Write the paper., get excited about it, have 'a really good experien^ce. 

^QUE?TI0N: Can one choose x^ur questions or Bill's? 

^ J2RRY;i No, ay s^rudents'^iaust do .on« of sine, and Bill's ^mst do one of 
*his four. ,lf ^"studjent were tp cone to ae, and say, 1 want to do the 
s^ollowing qUesticrn' which I have written isyself, L dight ed'i^ the question, 
a little bit and let* him go ahead and .do it^ 'I wouldn't* encourage that 
on the first exao, >ut 1 would encourage it liter. If a;student caoe to 
oe on ,the first rouftd with a good question, surel^^^e it. ' On^ of 
the reasons that I prefer not to have too many choices is this reading 
each'other'4 papers, and tlTe oor$ divets^ the ^estions, the greater ' 
number of questions, che less cooperation we have and less feedback froa 
each other. After all, I have to xead 23 to 30 papers* I can't give 
the© the kind of attention that they can give four. 'iClso, the fact that' 
I don't know as much about it as tijey do,, probably because they h^^ve 
just^ead-^e literature. Not. to say that \ don't know something *bouf 
it, but 1 am not^'beyond giving questions to which I don't have.uuyery 
good answer. • , r /' 
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TOM: We would l^ike to see wh^rc you do. Pick a question you ^IT*? know 
such about and pursue this as if you were a student* Later we are eoin^ ^ 
to show you soa^ papers that students actually did to give you sbne idea' 
of what kipds of products we get froi this kind of ^?ferience. O.K., we 
nave' lunch »in about 15 or 20 sinutes, ^d so all you are going to get to 
do now is think it through a little" bit, and get a look at soae of your 
tertiary and secondary sources and then after lunch have scs:;e tijie for' 
you to really try to get iato' journal litafacurel 

* . • * * - 



f 




Discussion of library exaainac-ion accivicy 19 

• \ ' ■ ' • 

(After spending abduc an hour working on cheir copica, (one •»r.ich the 
pacticipantd had select'ed froa the list of Library LKajsl nation questions) 
the groop reconvened co dlsr&usa their experiences and ask <;uestions.j 

,Ton-: Whap we'd like to do now, firsf, I 'a going to pass aroond copies 
of selected student answers to these* qucvstions. These are ur.aradcd 
samples which were just received last week, and the faculty hasn't even 
tuiished reading thea yet. I've looked then over a little bit. Tnere 

. is r.(^ question that they are soae of the better cB^' You'a?^ not 
seeing the poci^est ones, but I don't chink you are- seeing the best ones 
either. I went through 15 or 20 of then and picked out cnrce of :hi«- 
better ones. I have thea heret' I will pass thea around and let vou . ' 

take the copy for the one on which you were wofkii.^. Tr.ese .papers' are 
to give you soae kind of feeling as to what stud.*nCs • can go as. a result 

^or what they have been .through. What I'd like to do at this point is to 
open things up to all kinds of discussion and questions chat arise froa 
what you've been doing tisis^sa^ing and this^af ternoon. 

Question: I'd like to ask an opinion. I'n asking the kids who^ace 
writing cheais try papers this sesester to put in. their footno-tes, in 
square brackets, where, they found out gbout their articles., ' ■ 

To=: rnat would i>e a'very effective way 'of studying use pa<terns. 

Answer frra gcoup: just did chat in r:/ ce^py of^a student's pcppr. - ' ^ 
KHOv vnat this student didn't cq, right away. He dia not lollov iru^ 
rouce that I followed, and : ar* fgoing to criticize this paper if vou 
con t s^ind. iae stucenc looked up oat^; ne d^d not look up pollination 



I flowers by bati, not by insects or birds, or what have you. There 

J are certaiy trDpibal plants that are pollinated by bats. So I went to 
the encyclopedia which is an idea that I got out of the handout sheet 
tnat was given to us. ^ ' , . 

Ton: Li?t interrupt, rignt here, ^ne of the things we tMnJj^^ve have 
lo GO is to uneducate the students to I great extent about tnv baa 
naoits they have developed in hj^gh^^chool f roa poor instructioh. How ro 
ahead. • • t,f' ^ , 

I'^ri 1. ip.iisi : I r." id through liu .irtlclo in ti*o y.t; opi d ia v^-rv' 
^tiii#'..y uad laero w.id p*p..r:t,;/.i,>a on j-^u dui*.- Ini .\ .lad tifcr.- wnm-a 
- ^ refercHce.to a Car:aan cranslati^^n'^foy a./.uy ^a;&cd Wartz, or souec^kiV., in 
. / the year 1906, two volumes on j^oilination, froia the phcnosenologlca. point 
. or view, not aninal teasons, Dyt the phenomenon that was aiftosplished. , 

In your r^Avn catalog, they ha4* that 15(06 voitine; they didn't have ^ ' 

ancitjier voiuae that was' referenced. I then loo*ced up pQllination i^ the 
^ carjf catalog- and got- sotte^ others . One a 1972 book called. Pollination 
of Flowers by Proctor and Guild. It gives you the genus and spec.es, of 
. bats that do the job- and the flowers, on which chey do 4t, 'aad then you 
cari go into Bjolog-ical Abstracts to .see if ther^ is aAy othel stuff. 

- - • v 

^ jerryt But can you trust that source? 
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Participant: Ye2>, this guide gives references. T L.; is ori -.ir.-JI ^ 
literature. I hayen*t road the Original liter^.tur^. U'o<c^l .,avc onl'y 
worked on this problem for on*? halfAhour, and 1 ^chlnk that aS|far <i> 
person who knew -r.o thing abouw bats or flowers or pollinatiqn, I*vc 
learned ay library skills fairly well. The poir.u is that I-coulu look ' 
at the bibliography that this girl h^s vritten-and she coesr/c r^fer ' 
any of the papers which I have references to, ana it's all bat oricnced, 
and a-s I said, nat phenfeenologically ori^nt-ed, 

(Tho group discussed various ways in which the problea of bac polli-- 
nation 'i^ight researched: 1) by polllnacin^ bats, 2) by flowers 
pollinated byjbacs, or 3) phenooenologically . ] * 

Participant: tninJv this i^. what the critiquing by the other studi^nts . 
points Out to each student, there is c^ore than one wa^Vr' actackm;; tne 
probiexa and aaybe I didn't us^ the right one this ciae, but I got ^u&t^ 
direction. In otner words* I used the vehicle instead of the process, 
now next tiae I ^11 lowk for the process instead of th^ vehicle. 

Anoiiier participant: You look to eee which' is iiiore 'i^oportant^ or whijch 
will get you there the 'fastest. 

Participant: Yes, I will have to guess as li fresliT^an which ixlght bo the 
Qost proauctive. ^ ^ ^ , ' * * 

Parrlcipa^r.r ; 1 robin the terrltoriairt7~*'.VeSttt»n l>cc"*rjr<^ I chough:: ^ 
was soiiiething th^.t would b^? of in<*erest to z.e , After t*Aking I rj^ad 

* tne question agaia and I veciu^c tr.tit I vas going to play a g ^ri,-* 
the instructor which is tne way you get grades when you're a : rt- t-,.^*--*}. 
I noticed he askt*i a no^ioer of quc-.L* >n.^ so I p-.r;iO:.V"; ully 1 / - at a 
ber of dlffertrvt systeiis so i couli ;ind thw* one w..icn wju'l^ g*vt. ^e 



a^l tfie answers Lj wanted in^^ne ^stes, anJ that 1.^ wn^t thi^ btu^ltr.t 
has done. * 1 thirJ<L 1 coulc satis f actor Li^^anJ^^er his question oy picking 



•tne right system. Tnat wouldn T^'^gdv^/^ie zhe geneirali^atior.s that 
would like to know about territorallty^ but it would give ae^answers to 
/those questi€>Tis and I think thAt Is what a'fresmsan siig^ do, I would . 
noi like |to see pry students do that particularly but* I think that sight * 
get n;e the ''a*'. * ^ ^ ■ ' 

Cerry: . I think no cia'tcer what level we are working at^ there are going 
to be a certain r.uaber of students who are going to try and play the 
gar:e. il don't k^icrw how to ge.t around this entirely. I imagine every ^. 
system can be beaten by sonieone at sonetise. ' . ' 

participant: I don^t think it is a good question - beati^ng'fhe systeia - 
beca'us^^i^ certainly going to l^arn 5or;ething to be able t>o write a 
■ paper. .B^t in doing this I decided that a lot of the students I ce^l 
with were perfectly correct in their sense^ of frustration in using' so3e 
of the abstract, journalls. The first thing, of course, is that tney 
learn* their question i? large and they have to narrow it down as In ^ 
question 4 where you've asked thea tu discuss i^tlfros the point of Mi?w 
of the single species or single aaitial ^or bir^ or wha-tever. 
actually what' you have to do because you soon find out, 1 would ic^agine 



looking at a lot of these questioas, thAt the* aiaount of literature ib so 21 

vast that you have to do this narrowing" down process quite early. One 

of the tricks (at least' in wo^rking in a library about ifciis size) is to ^ 

look through all the literature that ib in the abstracted^ journals, and 

pick 'out the references that are contained in journals that you know arb 

going' to be here so you will have soaiething to read. * • 

Tom: There is an awful lot of gaae playing if you want to call it that. * 

^ - ■ *• 

Participant: ^ 3:ean you choose; you discount al^ the Russian language ' 
things, and'probably all the ^foreign language tlp.ngs, and then you 
choose things that look as if they :5ight, be here, like Be^^Tior, Ani^^ 



£ ehav^r > Auk , Aaerj^caa Kidland Na;:uTal£st , etc. 



^ Another participant: ^^t' s not really gaae playing chough, chat'*^ just* 
working within the bouroaries of the assig^usent. » 

• ^ f * 
, Parficipant; 0^ course. The other ching yoy- find is that Biological 
' Abstract is frustrating, to work with, oore/sp than Science Citatio n ^ 
Inde\, for exaiiple* All you really get is a nyaber with a very short, 
shorf^ title. It doesn't really tell you an awAil lot. You teally do 
have to look at the 'abstract to decide wiether they ape going to be 
appropriate or relevant. 1 - . * - 

Participant: For freshsen, I think BioAogica^and Agr4.CHltural Index 
would be^the 'easies^. Of course it doesnJ t cover asrnuch" \~ , 

Participant: i .wonder^ where xft^e overview comes though. It seea to sue 
tKat the fresHzsan \mo doesn't know anything had better find out: if ^ / 
anyone else has written soiaething in general about it. 

Another participant;:' Y^u do. Tne first thing is to put ourselves in 
the place of the student. You know a lot ^re already and you naturally 
> do things that you know are going to get resu+ts. TtH^'-iiist thfng you 

do is g^ to trie card catalog and look up the word that\j^. iti the jquestlon *• 
territoriality. Yau find right away that book^by Ardrey, Territpjrxal^ Inperitive . 

Participant: Did your student db that? -\ . ■ ' ' ' * 

^ Another participant> So ^ ' 

-Participant: Our. student didn't use the authoritative bopk '"trJ&P^s 
listed in Brictanica that y<5u have ^ this bibliography. ^ 

^ Another Participant: What is that? * *v ' 

. Parciclpaht: It caae out in 1942. Elton. .■ 

Another participant: This aay not be significant because the student in 
this 'case chose a particular species of bird that lives in Africa ^ind ^ 
that bird aay Xiot have been mentioned in Elton. Another question arisen: 
yoi| go Jook in sone of the ©ore general things like encyclopedias and 
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V then you go get these books froa the shel'^ and "inuScdlate-ly/f ind surr-ounding 
)' them,> other books chat are usefulA --x^^-...-/^ « ' \ ' c 

Participant: Anocher P9int I wanted to bring but' ii that In a nunibcr -^f- 
these indexing and abstracting service-s, the approach is by particular 
genus-species, which is why it is necessary sometiiaes to use that 
approach. " ' ' * ^ 

h ^ ^ . , 

Ton: I^*is only che handle for a .search', aj opposed to a concept t«nn. * 
With a cdnrcept cera you^have related tej:^ and nuaerous synonycis which 
make* the /search difficult. ' • ^ • 

* • ' ^' • . 

f ^ • 

Participant:. This is' a papefin response to the firs ^ ass igmsCTt? " 

lOrs: That's nLghc- mese were coiapleted last week. To give yb-u a 
lit;^le biograc/hical infonaation the prescribed burning qaoi»tion was done 
by a first tena freshman. Obviously the student didn't nake as ' 
eff^tive use/ of che Science Ciftatioa Index or^an ^Hstracting service 'as 
she aight. There are an awfui lot of secondary sources apd.old ones at 
that. Alaost all of her research i& restricted to the ^Journai of F urcstry / 
The articles are probably not all that bad, but itt is not* a presti^ge J 
/ef erred - journal like the Journal of ^lecular Biplo^ .or^ the Journal or * 



loxogical Cnesiscry or soxsething like that*^ The author of the lecssing 
^question answer, Sceve, is a freshman ^i^o. The auchor of che cer- 
. ritoriaUty -question on <he golden vinged suHbird is aij upper cia^s - 
political, scieisce oajor/ <^ ^ . 

Participant: 4Ref erring to the paper on the. golden winged sunbird] I 
thought that--was pretty sophisticated vriting-, -la to be cossended. 

. ' Toq:- Becky's is on bat pollination'; she's a fresha^n.' 

' . «i * ' ' ' 

Participant: She has done a aarvelous job. This is' beautiful, 

< > 

Question: Did you say y<fa have som returns on your questions? (Re'- 
ferring to Jerry's Library Examination Question./ . ^ 

jerry:^ Yes, I have got <nea, but I h«^ve not read then yet* •! have the/ 
^ 'Whole batch h^^re,. and you can look at what^ou want. / * , ^ ; 

ToQ': Tnis Will b,e' a nore representative s^aaple o'f what the studetit^ 
have done and i-t will be interesting to see how laa^ of thca di^i not 
reiy on prinary sources.' I'think it is faiy to say that oat t^he fitst 
^ Library exaa question the bibJLiographies tend to be anch sore based on 
secondary souxces; qhey don't *believe it when we tell thca we are going 
to look at the biblio^kphy. , ^ ^' . - ^ 

Response: You are just going to coun^ it, aren^ryou? (said lace- 
tiously) , ^ . f 

Toa: No, no, no. We lock at^he sources'; ^we try to nake sorae judgct^enr. 
/ SGseone said earlier this particular paper, on lesaings, did not rof^ n 
to Elton's classic work. We don^t look too' such for- the classic kind of 
thing at this level. For an tapper class course ^Aere the faculty wesier 



Is iiMi hln^ in ui\ area they aighc foc4 co4,)cLenC aC,*tluy do 

.•v.il^alo bibiUo,;raphic3 iiv ccras ol key w^rkb. but for L.il ; course wc 
•ire aot so conct rueJ with wliechor xhe sias'slx worko ur^ tl.ero, bu: 
• whether or not the sources chezaselves are gcncraUy con.^idered to oe - 
% ^ reputable^ Are /hey referred prinury source joern.i;s? Are thw booV.s ''^ 

' recent 6nes as 'opposed to ones tl^at are old and o'bvxously out of Guie? 

Jerr>-: 1 haven't /evon looked at who handed cae;a in anJ wi.o 'uldn ' L , 
this is an iiapartial sample, but what I /.ee happening la liiii, sort of 
V .exercise is the =;tudencs are developing .in understanding of science- *< 

I think thax is very importanp! rhey also learn soi^^thing about divers-ity 
4 and ecology, but I i>QS?ccf they ytil forget that>/ They may .not forget 
Che other, If scHaeone sayg they are having troublii,- I say bring in ^ 
everything you've got and l^t's sit dc^. 

l^articipajit: What, do you do when the student doesn't really answer the 
question?- Like this one... he has written a very nice paper, but it is a 
little w:ic^of th^ mark, in Tny opinion. I read the question, "Describe ^ 
the pol^in^rtion of two specie^ of plants by ba^s, I^iscuss the structural 
aspects of the relationship:" Tne way^ interpret this is that they ar6 
asking for descriptions of the structural ad^pjcatl^as the plant has to 
have IJR ordei' to stand the battering of being polSnated by a bat, for 
exaziple. And yuu discover that these f lowel:-^ , tend^ to be' lauch heavier 
and hang down soothe bat can get at it, and this sort of xhing is not 
• Hicntioaed ia the paper. In fact, she doesn't laake any, discussion of cs'ie \ 
i aspects. * What do you do with this? \ ^ •. 

> ^ * 

Jerry: I would point out what she has sissed, and the other students 
. would undoubted Iv do that, too. . 

^ Ton:: I wa5 reading-^e of Jerry's older paper whicH^^he had in his 
iilcs, trying to .^eleci papers for you to look at, and the^e were fcovercJ 
wltn s-tudent cosrients , '^and ^siost frequently was "You didn^'t ansv*er tiie 

question. You Wave been walkiag*all around it, you have a bibliography, 
but you didn't answer the question."* - - ^ 

Participant: How ^hen do you bring back to the student the readers' * 
concaents? , ♦ ' .V - . . ^ ^/ 

' perry: Get the papers back to thto.^ I recorJ the grade, but I do not 
\: record, the coments. The student can then keep on file with either 
<^^?y, the one, I graded or the other one. I do' keep^ne of the copi.es. 
I try to gee all papers back within a week^ hopefully less than that. 

•Question:^ Do you keep a record of the stuaerjts' grades? ' 

Jerry: Yea, 1 do record that. 

Question: Do you use tSe saae questions 'over again? • ^ 

* Jerry: If -l do it is a coincidence, but that trf alDr;e thing ve have > 
no^ said anything abouf . We generate >iuestions and bting xhea to Tom*, ^ 
and he screens thep for whether there are sources. in the library, so he 
aajr eliaiaate soae^of our questions, depending on what the Holdings the 
library are* Generally he doesn't, but soDetiacs .he does, and soaetines 
' I ' " » 
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after we. get through we wish we^had. It's harJ.to. decAde whether wo 
have the material or not, without spending a groat deaS. of time. 

Tom: We had an excellent example of that this year. The students were 

kcd to discuss sub-specialioa in the red tail hawk. The red tail hawk 
is a species which .h^s a very wide dis-tribution and considerable variation 
It^sounds like a pretty standard kind of question for aa aais^l ecologist 
to be discussing. There is a lot of literature on speciation •and s-ab- 
speciation. Red tailed hawks have been studied extensively and there 
should be no problem with that question. Unfortunately, I didn't have 
time to do the detailed kind of- search that I would llke»to have done 
and we discovered after we ha'd gotten the students into the question 
that ill fact the literature is pretty scanty^ It has only been in the 
last 6 months or so that there has been a good .research article on that 
topic that has been published. In» fact tUat^is what stlnulatad the ^ 
question. What the faculty member failed to realize is there^'^is no w^y 
to get access tx) that unless yoy 'already Xnw which journals to look at 
on a re'^ular basis. He had picked it up by browsing, which is what I 
think most *f us whq have subject expertise do. We browse rather than 
do a systematic seirch because we can eliminate a lot of superfluous 
material and browse in a very- limited number of titles. We get some 
questions every once, in awhi4e that really cause us a lot of difficulty, 
unfortunately most of the angylsh is on the part of the students because 
this is all new for tlfem and then to have such a .negative feedback from 
all their work is pretry frustrating. ' * , 

Question: Where do tl?ey go to get materials that aren't in this libr*»r^?- 



"^om: For this, they can go to Miarfl. It is only 40 minutes away, but 
^most of them dou't have cars. This assignment Is given one week and due 
the week latec, and th« idea is not to do a. comprehensive-, • thorough 
search of phe world's liter^ure on a part?^uiar 'topic* They^rc to use 
thja basic strategy we've giv^n them and hopdfully we have selected 
questions which, most of the tirie,^feenerate ^ sl^pable bibliography f rpm 
which they can select ^ reasoaabla number of sources that we have here 
in out* collection. Sometimes ,'\ike ,the territoxiality quostion^ tr.c-y 
could have easily picked an organism where we have nothing, and we tiave 
to try and counsel the students, "Don't pick ^ Sib'erian rat to work on 
because we don't have the literapure." Because we ,ar^ In regular 
contact with them we dan head off some of tJiose problems. . But thefe are 
real problems and you have to give attention to them or you develop a 
lo; of frustrated- students . ' 's4, 

Question: During that week are there other ' assignments? Do they' still 
come to their classes? Jerty W: There is regular reading in t\ie text ^ 
every week. , . V ^ 

Ton: You might notfe on t^e handout sheet that we gave, you with the 
* library examination instructions. Tn^ copy I've giv^ you is the copy * 
V from 1974. We have revised it alightly for this Fall'^ course, ^We 
jchanjedr the time allotments at the bottom of that page because o^ the 
constant badgering.' They say we are being unrealistically conservative 
about, the «abunt of "time that tl^ey ^hould axpect. We have changed ' those 
now^ They .are now 8, 1, aiid 3, ' ^ c^^ 

Jerry: John just told oe he'^d* ^pentl 15 hours. 

PattlciBant t That's 20% ot the course, ^ 



Xhey 



Jerry: 1 cold him n^^-^^o .do chac>^ but ic*s coo lace now. 

Tom: Tae- firsc one is always" chac way. They spend exc*es5,ive amoancs of 
cime because a loc of ic i? simply learning co use che libracy, ana 
make very litcle progress on che subject. 3uc by che second one or%y 
Che chird^one, they are just in and out a The research is done very 
quickly. One of fhe consistent criticisms of che course is che ^mounc 
cime required. We raised ;all of che time^ exccpc for che organi^^ation ' 
cime. ■ * , 

[Break, then j:he discussion coatinue^i. The tape missed the first coraen^ 

Question: Wouldn't that be a logical extention^ of your admonition not 
to trust secondary suurces. • * * 

Jerry W* I was trying to 'come up with something like that. One*<^f the 
point? here is that we want tc get out the dependence on us. I dt^t 
know very much. The 'literature knows a tremendous amount. . I am going 
to get out of the way of their learning* After all, in most courses, 
the teacher sets the upper limits on education. You can't know any more 
than I do because where are you going to find it out? But there is a 
lot of stuff in this library that tto one person can know, 

Krom the group; Tnat's the advantage of being a librarian. I always 
say,/*Well, let ' s. look 'for it together." 



Verry W; We're taking that role. 



Bob Johnstoae(Ear]ham PoXi^.ical Science Pcofcssor, talkiji,; about liL,Cory 
instruction): , / 

. Oovonuncnt documents are- an important source- for polUlcal ..-.c.^'nii:.: i. " 
But students don't know tij^eir usefulness. We arc u r.pvernfficnc ti. .>o,^itory 
and reams, of inaceriais'are sitting u? thore in the library that'si-nt never 
bC-ysed by students who when th«i/ dd research, go to the .card catalog and 
the standard indexes. VTnat I crying to do, parcicul.iriy in Ai^rican 
Politics courses, is to get students faaiZiar with the u.^e of governaent 

* documents so that they won't be turned off by che Obscurity of the 
. timber irig system and all ihat.- This is. useful in two*asic wuys. ' First 
of all. it is useful in gathcring.addl tional data. ' Tne government is an 
mrornaCion generator of enormous dinensioa: It's &n information compiler, 
,in audition to th.»t, and an -Inforaation prosulgacor. It's extrcn^iV u.t- 
.ful particularly for statistical evidence, but not just for statist. cai . 
evidence. ^Committee hearings in Congress are of" enoroous educationa! v.il^e 
to students of the legislative process. Be^ng able to find then, beiu^ 
able to Xook them^up arid dig them out is (extrecely) valuable. Not only 
men, for purposes of gathering hard data, bwt for purposes of understanding 
institutional arrangements in tl>e goverruaent. Students who are i.iai i i<.r wi t.h 
governaent dtfcuaents and can use then easily are cade r:ore rer.di.v ..w^rt- o: 
institutional relationships, of the process of goverr.ncnt. and also sjr.ei:. .r.g 
tnat is important,, to me at least, tne scuff of ?oli:ics. Wn<it ly. ,.o.:.-, 
oer.eatn the organizational flow charts; what is rea'l.y happer-ir.^. " . i-..v :,.:,d , 
well, I find, that t^Ls is a tremendous way to awaken ijiij^trTst.' in .v-: r-i- 

-.ent because they find when they -do a piece of research-on leg. s !«: ive ...... :u r 

tnat the governneric is not only soae kind of nechanical mout-uut;. .'r -\ 

out 13 'in fact hun-m beings who have interests ar.d actibas'ar.d pr! 

Tiiis is particularly crt*- when students are introducec ' to the .ey i-: . ... . v; 
documents. Cor^icee hearings, floor debates, and the like are where 
.-ieart or govefnaenc energcrs. . Tr.e'purpose of getting them involveo wichj. 

' government documenLs-'is a> to froiliarize theo with new sources of d^tu, 
a) to help them to understand the process of ^ government itseii. I <]....'! 
•Jl.nt to take too tuich tiiae m liyihg this oat, but let oe just j-.iv. vu.ia 
couple 01 examples of what we- are worklQg''on in tne /usericnn polii.. 's cour..v, 

'O.ne of the projects in the introductory Ai^ican'^polltics cour-.t .Is .1 kind 
of legislative history that requires them to produce a term p^per at the end 
wnicn traces the progress of a particular idea or proposal fronj its first 
.articulation in the- governaenj (which sore often than not is in the Executive 
Brancn), to its intrpduction in legislative £orm and its pr.ogres*- throu^-;, the 
Congress, both Houses, and then finally through the' adjudiqation proce.s.s in 
tne courts, mis is an idea which 5vaa Farber and 1/ are* beginning" tj? oeveiop' 
which I haven'% done before, folly^in^ it that far." Tne way to do this is to 
pick a piece of legislation that %as. h&d all these'. things happen to it: 
passed through Congt^ess,, has gone up through the courts ^nd- had" its constir- ' 
tutionality. decided, "^ac Cnis proj ecc 'dbes is require theo to a) find 
^xecutive documents £hat^ illustrate the progress of the idea 'ov propo.'iar , * 
b) follow it through t^e legis-iati\>e proceSs from irs introduction, referral 
to committee', through coamittee hearings (We try .to find 'a bill that is 
Qoncroverslal, for which there are 'hearings* so tn&,c they can see that asp^^t 
c-t it),- through the report sta^e. debate, oa the, floor, the 'finair*passage, . 
t^ne President s signing o^ the" hill ^nd then on to tV courts where they 
tnen get involved with judiciai.iiQ^uaents*. ro4 end propuc ^ of - this is a' ■ ' 
narrative term paper, which fulfills the expectasions of che nolitical science 
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course In understanding the process of gbvernm^nt^ and secondly, it is a 
serig§ of library exercises, iJhich introduce them ±ti a fairly comprehensive 
way, in a way they can^t avoid, to the resources of thp library. 

Xher^ are ^rariations. on this kind of thing in a jcourss on the U.-S, Congi^ss^ 
For examfvlj^, I ^d my students do a committee study. They picked a committee- 
^f Qongresss* and they e^famined .th^t committee in adtiorvwith a variety of 
types of proposals ' so that they can see the political realdt.ties^piaying 
witirtn the cbnfines of thaS committee, and also understand the relationship 
of that cocpnittee to the parent house* In Coostitutional Law courses we 

' have our* studeAts do. research to update a Con^Jtitutlonal decision c^de * 
about 10 yWrs ago. They l]ave to try and find o"ut what has ^lappcned "in 
that particujUr area of the law si'nce^hfen, and that gets [the students^ 
familiar with jx^ci^l sources. I think ^is i^ extremely important, this 
library assisted instruction, if yoii wandfto call it that, -to political 

' science. ^ 

I was just talking tb a professor from the UniTrersity of Kentucky . today 
who is here to recruit^graduate students co his program in political 
science. He was'saying they were forced at Kentucky to require their 
students, their first. year graduate students, to take a course Tn how to 
use the library, because their graduate students were not able to find ^ 
their way tia^rough political science sources. I think ,_from whax I caz^ 
^gather, I've only been here a year or so, stiidents fr^m Earlngn at least 
don^t have that problem when they go to graduate schooir^jji political 
science. ' I'll stop^at'this point and ask if thete are any questions. 

Quesp:?^: Is the instructiia in the use of the :iibrary provided by the 
lib^&iryr'&taf f or tb^ political science departmeat. 

"^tjy ... 

Ans. will be provided, and this is something we are 4eveloping as 
we go here, initially by the library staff. Tney^ll cofme in and give 
a lecture on each of ^he stages of this process, the executive documents 
and how to j^ind them, the legislative and judicial documents, and thep 
the process will be assisted along the way oy me and by tne library 
staff in giving assistaiice here and there 
^ . ^ • 

Evan Farber' (Earlham's Head Librarian):. Let me interject something here. 
I found that the most productive way of doing this is if I gave a lecture ' - 
to Bob* 8 class and Bob is sitting in the class. Tne interplay &ettf*^en ^ ^ 
him &ad me is veri;y important because then he can pull out illustrations^'" 
which I have no knowledge of and reinforce what X have to say. That is 
very important. 

'J 



Bob: Tom and a colleague\gave a course last- year, for the second time,\ • 
on government documents. It was 1/2 or\l/3 credit course, and I sat in 
on that, aid I* found it ^enomtously helpful to me, but I think^it is mbre 
useful to the "Students if th«y do it in the context of a class 'where 
there is substantive attention rath^ than going away and not feeling any 
corresponding reinforcement in thejrlassr^m. .And tl^t is what we are 
trying to desilgn into the program; dbii^some thing coQStructive and 
important in other respects. 

Question: Can you mention some o£ the. topics that you have done that 
went all the way through the exect\tive, legislative and judicial branches. 



Ans: Right, we pick a bill that we know in advance* has done all this. 
^ good example -of th^t is thyCivil Rights Act of 1964, which was a ' " 'V' 
ciJfifcroyetsial bill, /and recast enough that it is a part of coateiip'pxary 
history. It is a bill that was pieced togetheS: through a very complex.,^ 
strifes of relationships between the Executive Branch and commxt tees of ' 
Congress^. <Jhen it got to Congress there wereraany attempts to obstruct 
the legislative ptocdTss. And then of course^ it vent 'on to ^he Supreme 
CourL. and that is a particuUrly delightful bill because iir deciding the 
constitutionality of that Act, the Supreme Court based it on the Commerce 
Clause. . » V* - ' 

Quest ioo: Hpw long does it take yoa to teach Shi's , 'the govertusent ' 
docaments? % . 

' ' 'f 

^ Bob: The* course chat was tfaugl/t was three weeks long and net three* days " 
a^6ek for an hour. 

Tod: rnere were. a Series "of exercises *to go along with that; they were* 
.'done between lectures, outside of class. I think it is fair to say that 
we arti incorporating the concepts of trfat course info xhe' political science 
curriculuar • 

Question: How do the students feel about that course? • ■. * ^ 

, . , > . ~ " , 

Boo: This particular course, the one that follows all the way through the 
judicial process is one that I am gping to teach for the first time this 
Winter term. In the past; I have done this but stopped. at the end of ' 
the legislative process, and" it W been very well received. You can 
understand why because when you get into those docuaent^^^at least when 
I do (and of) ceurse J'm prejudiced) and when I did wKen'i'was a student, 

found a i^ole new world' opening up for me. . I'd forget what I was- doing. 
I d get iianersed in these documents." Some of them are, dry as dust, .but \ 
some of tHefa are vex^?; very idteresting. The student^- fi;id suddenly that 
a whole new source of information is there for them which they never thought 
was available. People' thinlc that if it is a government document, it is, 
bound to be political in nature, the information is bound to be prejudiced, 
and therefore, is not worth considering; it is not scholarly. Yet only a 
ttny part of the iceberg is pblftically affected. " ittost of the information* 
that the govermaent collects and publishes is done by scholars. ' 

... * 

Question: Do you h^ve an outline 'for your dourse yet? ' * - ' 

. . -^'^ ' ^ ' . 

Bob: I have an cfutline for an earlier course, *but.*i don't have one for 
this new one drawn up yet. , , - ^ .. . ^ ^ 

[The outline for Earlham's separate course on govet^Bient documents is included,] 

Question: In science literature an author cites references which >cLll always 
appear in articles, that will buttress whatever arguments he made, or 
give further evidence. The same sort of thing ifen't a^ays avaiUble in 
government doc\^j6nts. How do you approach this sort o£<*probleo? 

Bob: Thereire sotirceS that they go to. The Monthly Catalog of Govemnent 
PubllcatiqiiB, which lists things by subj.ect, and it Is a, pretty eshausCiva^ 
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Catalog of what the governaiflt he 

Evan: The mogt important- source that they would \js% now is only about 
five years old. Die Congressional Xnformatioa Service. It is very 
- .thorough. 

(Juestion; Do you send thea to non-goveraaent Sources? I 'a thinking 
' particularly^ of things like Congressional Quarterly Weekly. 

Bob: Yes, in fact, the 'Congressional Quarterly Weekly and Almanac are 
invaluable places to begin. You can get a lot of short cuts; they will* 
refer you ^fiirectly to coisaittee hearings,' and all the other sor^zs of 
things that taJce place. 

^ Questiori: Do you have American Statistics ladexZ 

Ans: No, we would like to. ^ ' 

Response: Yes, it is expensive. , * ^ 

Question: What do you do for the scholarly literature? • 

* « 

^ Bob: W4II, we direct then to the indexes. Social Sciences- Index , and 
of cours'e Readers* Guide , for gefierai articles. We just -star tec getting 
International Political Science Abstracts , which will be a hel^r 

Evan: . We hdve a real /ardvan^kge using Social Sciences Citation Index because 
so oany kids take the introductory biology course and when they cozie to the 
political science courses they are already familiar with the Science 
Citation Index , * 

Bob: We get a lot of students who have not had that experience. There 
is still the/'Two Ciatures" problem around here, so we have a problea 
convincing religion and philosophy sapors to. use the naterials, .and 
they are not faailiar with these indexes. 

Evan: But even the philosophers are pjjckigg' up, gbcial Science Citation 
Ind^. It covers about 15 5r 20 philosophical journals. - • 

Participant: What, do ^ou use for judicial documents? . ^ ' 

Evan: Supreme tk?ur^s Reports is the sain source, th&i there are sevAal 
related, tools, the Suprefae Court Review, raich is an annual collection of 
articles, that analyse. the court *s activities of the last year. ^ * 1 

' Tom: Perhaps Ve shb^ gp on now and hear Evan Farber. He Is going to 
talk about our ia3tructiotr in psychology, and with special ec^hasis_on * 
the question of hpw the;;;structure of the literature of psychology affects " 
the instructios that 'is done. 

Evan: This is ^ bibliography that was preparcid for a course called 1 
Psychological Proteps, which is the baaic^ijourse that ail psychology 1 
. aajors take. The thrust of the course i£^ %o teach the students • ' ^ 
aethodology in jpsycholoffi^ i,e. aq>ey5sentati0ii, statistical aanipulation. 
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Part of it is to teach th'en how to use the. literature in psychology. The 
assigniacnt that we worked o.ut last year, has been developing over a long ' 
tine. Originally, we used just a typical type of papeV,.- students could 
clioose any top it. The assigaaent that we worked- up last year was chat 'the 
ft^udcHts would be given^ a revi^rf article, nomally a review article.. that . 
was published 4-5 years ago. Ilie student's joh w^ to^ cak6 a ^^ery specific 
aspect of that review article and tipdate it. Vnat- has been lihe research so 
^rar, how has that particular concept which was. analyzed , sTX=^Tized a? -zo 
that point. What has happened to that, concept sin,ce that tise?" Tne 
instruction was given with that i^-cdnd. . Tnis bibliography (cse one. being 
passed out; it is available frca the Project Dir><ftor at 10<S per page, 
there are 37 iS^es) thfen is for thea to keep, ^e.tell then that .this 
bibliiTgraphy contains all the reference ^orks in psychology and related 
fields that theyXare liliely to need. In the back of it, -beginning on oage • 
2^|||is the search straeegy^e tell thes to use. .(reproduced here) .v WhSt / 
we^alk about first, though, (on 'page 33, of the bibliography and reproduced' 
here) is a tine chart, which gives t'qe studen.ts sose idsa of how long xt - 
takes an article to get froa the t^earch stage Into encyclopedia." Tne 
tiae- scale on the left, and begfriniag irith somebody *s .r^earch which is 
published in the fqra of an article. Ejitsnt'ually it gets into Psychcloj^ical 
Ads tracts, is reviewed, and finally app&rs .in psychological texts. It ' 
gives Chen so=e idekof how' long it takes thes^ things to oappen. They 
aon c have any idea of that, or% course." On page 27 is the, generaj.- idea 
or a search strategy. I have to tell the3 how tcj use this and that it will 
not apply in all cases. ^.Tnen we go on ^o page 28, and I demonstrate a 
saap;.e search using a particular concept whicti I chose sisply because I 
was able to talk about it wich so=^ knowledge. Z>used the Pygnalion effect 
in educational psychology; the effect <oat students will live to or do«a 
tA the teacher's expectations, ^tsrting with sose hancbook or encyclopedia, 
you can begin with the Sncytlcpedla of Eusan Sehavior . looking under 

Expectancy effects", going. to Eoseothal's article which shows the citVtion- 
dowa at tne bottom and then looking that a? in the car^ catalog -to see If 
fne library has t"be book. They are shown the use of ^racings, s'o that 
although they foimd this book under Rosenthal, one of the subj^t- headings 
it is under is "Predictions of Schoia^tic Success", and the idea t>f showing 
that, of course, is that tracings ^e difficult to find, but they can be 
extreoeiy useful. I.^ever thougnt about and r's» ^ure students ^couid 
never have thought ^ut using "Prediction of acholas-tic success**, as a. 
subiect heading. JJie next atage in the search is use of tne Affnual- Ke»iev 
or Psycholo^, Psychological Abstracts and the Social Sciente"citiEi5H 
Index. / • : . : : = — 

Sose thing else p. pointea out on. page 34, vnlcli is" kind of ^ 'interesting 
thing but is n^t relat«i .tp this particular.' ^slgnsent/' What, it shows 
is two Catalog} cards for what turn out to be fche sasp^book. I explain 
to thea how I /happened to order one book which I saw/tKe review of in the 
Sew Scientist.'. A British publication which reviewed the British edition. * 
I ordered it because it was by Eysench and then raj4 across ^ther review 
or a book by Eyseilch called, Tae l.Q. Ajrguaent. vUch I didn't rcaliz? 
at the tiae was the sa&e book, 'and I orders it jklso. Vd seen a review 
in perhaps Science. When the book cas^^in, it .looked very faaiiiar. 'L 
went to check the catalog^ card and. found otxt, tMt the earUer'boqk weM • 
gotten was exacay^the saae book. The only difference being one- page of * 
introduction. The text vas exactly the sase> Bie point is tfiat the two 
books are classified differently by the Libt^ of Congress. ,One in BF 

' • , ■>' ■ 
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and one in LC, and* they have different sobjecc *h€adiags. One under 
"int^iiectuaL Level" and the other under "ELhno-psycholog>'", one for 
educatioji, one 'for intelligence. The point here (a poiiu: we've made ' • 
again asd again) is the inadejjuacy of th^ c*ird catalog. You use 
Citajfions, bibliographias, and abstracting services. The use of the 
card cat;alog is very undapeadable. Tnere are tricEi to using it, very 
'helpful tKings, iTut it'is uot very useful .because of its inadequacies* 
Tne stnictuire of psychologic^ lit erature is vary close ro the structure 
of^-bif^iogical llteratu^re/' It is v^ry nice that r^st'of the students have 
•taken Qe^tal Biology', and so they know vhar I as talking about. 'Tnat 
presents a problezi because while half oT this , /lass vere s^ho^res,^ f^e 
other half were fresmien vho had no library issttuctiora a^ all (pat^y of 
whoa hadn't had General Biology) • Eov do you talk to one group vho are 
fairly sophisticated already? What ve iiad to do in this case (we were ^ 
talking ^^arlier of overkill as a real danger) w^ to find out froa the 
instructor who were the freshaen who had not 'had G.3. ^ fifelk to that 
groiip first and gfve thea basic instruction to bring then to the level 
of the other atudents, and then I talk about the general resources in 
psychology! It u^ to be that we could de^exxd on^ students proceeding 
very systeriaticaily'^rough a sequence of courses • Jk?w they don^t proceed^ 
that systei^tically , We get freshsen taking advanced courses, seniors* 
taking freshsen courses. The probles of overkill, the problea of dupli-* 
cacing effort is a real danger because students say, "Oh, I've heard ^hat 
lecture befpre."/ ' ^ 

^ » 

Question: Have you tried tx> develop any assess=.ent tools to use, such as 
a pre- test which you might adsdnister. 

Evan: Actually working with this particular coiirse, Basic Processes, for . 
next tera we'r^ working with Dick Johnson oh a new assigiSLent, Zha stud^fs 
are a^ked to take pqpular articles fror Tin^ or Kewsw^ek on new develop- 
:^ents in psychology and then find out what schQlarly articles on whi&h 
that popular article was based* Eut we wiii gi.ve then this first, before 
any kind of insttuction. Larer on in ^he course, after" library instruction,, 
we will give thes pretty such The sar^kind^f Xbing bM taeis to"' follow * 
if through. When'they do this, we- are gqing^to ask^thet* to log their steps. 
Actually viiat we will, do is.iise a tape recprder and &Bk pes what steps they 
followed, and then coc^are/this with the efficiencies their first 
experiences, / • ' 

^Participant: That is yd pretty tough problea which you proposed because 
shere are aoong us {;ae and ay colleagues), people who announce their 
scientific results, in the" Kew York Tiroes and that is the ?aly docuiientation 
th^e is ior it. If you gave one of these probleas^o your students they'd 
find there was rx> way it was doccseated. Sven wit ytlxi^e and Newsweek 
publicity hou^sds g^t thess^lves into those places, and that is the first place 
It is annoxmced. It isn't announce by sending it to soie referred journal. 

Evan: That is one of the purposes x>f the. assigmient.* It is not just 'a 
lifirary assigmaent* * • 

Another participant: Do people do that fo they won't. he beat out when it 
is pii&lished- or what? 



Firsc participant: I think that's right. It is frecyeacly a seaas of 
estabiishiag, priority. You doQ't See it la- people's Vtae. 

'Question: ,,Whar ve rto into vith psychology is „that our library' is divided 
into Sciences and Huaanities and 'psychology is in the hus^aiitias except for 
part or it which is in the sciences. Stxidents go to one place and don't think 
to go to the other! . • 

Evan: Ke have the sane, p rob idn in that physiological psycholog:/ is in the ' 
^cxence Licrrar>' ar.d social psychology ar:d sc forth are, in the Kaisi Librar-/. . 
■soaetises I j-ost f.ave to cose in ,and talk to the psycholog-,- majors and exjilaia 
yny oecause they are very unhappy about it. If they are. using the Y^Lt. 
Library everything is in that card cafalog, li rhey are using thd Sclc-nce 
..iorary, oaxy the Science Library =;aterials are listed. % 



anicipani: : xne Science Citanion Index and Social Science Citation Ziid^y 
otth nave soize psychology and they coa't cospietfely overlap, tney uncer:17. ' 
\ou *eaxiy nave, to look, aac see w:;i.ci;~;^ournais are ^here. 

Another participant: Is Basic Processes so advancK* co-arse? 

cvan: Ko, it's «the 'first require xourse for psych majors. 

Participant: you nin the sat:e 'comparable tizie to the biology course - • 
about 9 hours of library instruction? 

£,van: Ko. Probably zry lecture vlil ^ust be an- hour. , , ' . 

Question: Is that because you can build on General Biology? Are you using 
G#3*, as a basic place to begin? 

Evan: Yes. Tne only probles is that you .can't depend* upon students having 
aac General Biology, , ■ 

Question: U there another coiirss ttat is as basic as (jBneral Biology? 

Evan: Yes, in the Huaanities cbur.se vhieh every freshnaa has to take vith 
very rew exceptions. But^the library instruction is very general.' We- 
are introducing thea to very general concepts. I cen'.t -say it is basic to 
everytning else because frequefijly the instruction/relates iust to the kinds 
£^ tnings they arevorking <S vhich sight be something like- George Orwell. ' 
iaat isn t sajch help .in dealing" with psychological literature, but again voa 
are dealing wiw soaB of the coa&pts: tracings, use of bibliography, inkdeqaacy 
o. the cafd catalog, different k^aiJs of indesang and abstracting services. 
I have to depend" on later ■ courses to refer to those materials that are 
specifically useful for .those courses. , 




Question: - Have you work^ oat. the kindfcf tiae requireisfents fbr this particular 
assignaent? / . • j , 

- 'I- ■ •/ ■• . , ■ , 

Evan:. Not yet, biit we working oa'it.. We are going to have 5{o put a tioe 
liait on tne assighaeat^ because the coaplaint we got last tiae' viiile the students 

' . .'A . ' 




spent only "a short tioe^learning- how to use the aaterisls > so;3e of thcra. said 
they spent about 20 "hours searching. ■ * . . ^ • ' 

. ' * -. •. 

.Question: You doq't have Argononics Abstracts ? That oae we found -ver* usjsful 
tor psychology. It deals in things like space- bub'^* and the ructions to ^ ' " 
ousic being played in the office, and anything to' do^vift biology and psychology 
combined. • • . ' * ' , , . . , . • 

Evan: No. ^ There are lots of abstracting services I'd li"k§ to have, ( ' -- . 

Question; Which 'ones do you think are' aosc useful for psy.chology. . ' . • , 

gvani Psychology Abstracts^ ' of course^ The Aaauai Raviev Psychol-ogy . sad 
now The Social Sciences Idtfex and The Social Science Citation Indea . 

-question: Do you do >any thing wifch Borrows The Mental Heasureaents Yearbook ? . 

^ » - • • 

Ejran: We d6 use it in -a course in educational psychology. 

loa: Are 'there other questions for Evan or Bob? , 

Question: is this instruction written into the course description of your ' 
courses? , ' » ' ., 

Evan: No, coilrs^ descriptions ^e like college catalogs. " You can tbrov? in . 
wnatever you want to. Course descriptions in .the college catalogs have c6 be 
written so far ahead that they are written in general tern*. 

Question: I guess- ny real, question would be: Does it cacter viio ia. teaching 
the course? ' • - ° 

Evan:. Yes. First of all, soae faculty are not receptive to library instruction. 

Question; So each ' .seEsester you- negotiate what- is going to happen? 

Evan: Except when no other person teaches that course. ' • ' , - . ■ '• 

' ' ••**'.' * ' 

Bob: la our case, no one else at the college' teaches" American Politics so 
we don t have to worry aboUt it, especially with a small staff. 

Jerry; 'That's true all the way across the boArd. Jfertainly not in our area.' 
We re not unhappy about that. Ve see teadhid^ as A fora of s'61f-expression. , 
We don t want to push off each other's self-expression on another person. 
That is not to say that we don't want to arpxjt about the value of -a particular 
=etnod. If tlje ai:gujaent. doesn' t convince, then we say, you do it your' way , ■ 
I do it adne because you'll probably' do a better job of doing it your way *' 
than you would doing' it aine. ' ' 

' ' ' . * ^ 

Evani It'.s teapting to sake Ubrary instruction the end. It isn't. 
It enhances teachiaa, ' Ti ' ' • ^ - ' • 

- ."^1 . ' • '"^^ • ^ ' 

Participant: We are' just feetting l^to'a iiore systeaatic ;Sppraac^ to ' ' ■ 

instruction apd it really concerns', jie how we are going to budget '-oiir ■ ' . T * 
staff tine, how are we going to Icaow f^ enough in advance, ' * . * 

Evan? It is really lapt^sibi^ because soactlae. tJie -need for ajLhtary^ * 
instruction cosaes up ti^t across the reference. desk. . ' . . 
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Tom: JcFry a^d I have been conferring over here in tht comer and we . ' 5** 
wonder how the participants are feeling at this points Are you^so 
saturated with informatipn and sat in this rooa long enough that .you 
feel you've got to get out: of here. There was" one "©ore of these shoirc 
presentations which I was* going to do on chemistry, and Jerry was going 
to be here to answer questions. We can px*obably do thajt at another time, -f"^' 
if you feel that "you want to get away from here for awhile, or we can go 



on* 




Participant: We sure don't need it, unless you are 'more perceptive about ' 
our condition than we ar4. ' ^ 

% . I. ^ 

Ton: . Jerry^s coszaeat was that people seemed to be very excited>" h^ve been 

listening^ and' asking questions', and too much 'of a good thing mieht over- 
mi. ' • ^ ^ 

Tom: I am going to pas^ around to you now instructions for an introductory 
organic chemistry course. What I am glvdlng you are actual copdes of the 
assignments given in two- different bourses taught by .two different people. 
Tne first one I am passing around says **Covalent Bond Term Paper" and 
G, R, Eakker, Spring *75, and that is, Gerry Bakker's assignment for the ' 
coarse when he taught it* (Copy included here). Last spring,, the course 
was Zaught by another professor^ Because strategically in the curriculum 
it is the first course'^re aBe sure we nave all the chem majors and only the 
•chem majors, and bio majors. Chem 11 and, l2 which come before Chem 13 have 
a number of people who are not science^ majors, and the courses just db not 
^ lend themselves particularly to library instruction- 'Over a period of several, 
years Gerry and I and other people have worked at ^at *^'nd of library in- 
struction to give; what kind of assignments to give that would be successful 
in achieving 6ur- objectives. The assignment that Is written up there is what 
we used, and from my perspective that assignment has been enormously success- 
ful. ' -? ' ' 

' Now to do that assigpi^ent we had to ;^rovide them with certain kinds 
of ihstruction. tie did jtor do the^indHofe thing we did in the Ecological ; \ 
o r Gepe raj^ology . We did not give than ah introduction to the chemical 
IfreraTure, We dealt only wiUi'the problets of Tinning information on organic * 
coiiq>ounds: I am going to pass out to ypu now fot your information the series 
of exercises that -we used. (Copies included heres)^! wei^t to the class^and 
talked for about 45-50 minutes 'dealing with topics like "how organic' compounds (U.) 
are listed in tables and indexes", pijobleas of "inverted and uninverted names," 
• problems erf comeaon ami established names'*, "problems of proprietory names." 
I t^ked about formulas and the different systems /or formula arrangement /" 
that have grown up and are Used in the literature. Based on that verbal 
instruction, we gave them a series of exercises. The first oQe deals 
strictly, with handbooks; It is , a" very simple thing dealing with the two 
or three c^)st' important handbooks. The students do these in a we6k*s tiaie 
and turn 1$ that exercise. The second exercise they get shows how to use 
Yhe Science Citation Index in searchiRg for chemical synthesis. We;;:ry 
to show th^ how it can b6 used to find applications^ of synthesis procedures.' ♦ 
The third ^ercise (they do these as rapidlv as they want but they all ought ' * 
to be f inist^ed in a 4:taree week period) covers the use of Chemical Abstracts 
^o find 'information on an organic compouivi. I would caution you that we are 
n6i^ trying tfo be' comprehensive so students do not get a thorough introduction ^ 
" to Chemical Oistx&cts at tiiia point • We are ojay deal^ with access to . 
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^ information on^organic compounds and" since these are beginning organic khcra^st 
students, their compounds are not complex biologicals or polycyclic compuunds. 
Therefore, we don*^t go into the depth and deJtail oh how Chemical Abstracts '/ 
Handles these complex compminds. You saw the terin paper assignment that we 
have given, (copy 'included here) They have to actually work up. a synthesis 
and a degradation for a particular compound using tha^ labci^ed cai^on atom 
^ as ^ way of checking the isynthesis procedures'. It is a^.nice handle for the 
faculty member, in evaluating the paper. . 

Last year when a new faculty soember *Caught the course, he was very 
concerned about the rigor of the course. He felt the course was not 
. adfe^iuate to the needs of students going oa to graduate school. He was 
very concerned that"^ there wasn't enough content. We^ were- not able to 
convince hip that he should allow enough time for that kind «f assignment* ' 
because it took a good two weeks at the end. of the term -to ctomRlete. They 
.had no lab assignment for those two weeks while Chey^were doing the paper. 
The new faculty member did understand a need for someljasic Instruction, 
particularly in the use of handbooks and some of the data compilations, and 

. he wanted to get th«a familiar with some basic tertiary and secondary sources. 
So he devised- an assignment which is on the second assignment sheet you ^ve, 
;:^novn Chemicals Project, Hay, 1976", We' typed that -right off of his hand- 
written syllabus. (Copy included here.) / The point of this ^ustration is 
simply to/show you how different faculty members have apprdlB^d library 
instruction arid ha\fe u^ed it and incorporated it into. the c^urs^ with tKeir 
own objectives. That's important. Tne librarians who are present must 
realize that they aren't setting the objectives for the courses*. They aire 
only going to be able to indirectly influence that br working directly, with 
-'the faculty. This -is. an illustration of where different objectives on the, 
part of the faculty members result in different kinds of library instruction 
activities. To prepare the students for this assignment, I gave somewhat 
the same kind of presentation about names and^ formulas and how they are 
arranged. That seemed to be basic. He agreed' that that was the basic set 
of information they needed. Then the students-did three exercises. We had 
them do the handbook exercises we had used previously, but we did not have 
them do the Science Citation Index or Chemical Abstracts exercises becausfe 
they were not useful to th^e assignment. Instead, w.^^ad them do a new 
exercise which is on the use of Hui^tress and Millik^n and th^ CRC Handboo k 
of Organic Compounds which are two^sets of tables which are organized by 
property and chemical compound class rather than by any alphabetical or 
•formula arrangement. This is a very homely exercise which simply shows them' 
• the power>of these two particular reference books, in finding information, 
about unknowns a^id how to idejitify an unknown using the ^.tteratui^e. They 
th^n took either Huntress and Milligan, or the Hand book and used themifor 
access to the primary journal literature. We just**let the student go from 

. those sources to the original Journal without tire use of indexing* Iqols , 
abstracts,' etc. 



Now one of the questions that w^ are aj^king and: which the professor ' 
is asking is what effect this has on 'the student in Chem 51 which is the 
upper level organic chemistry course. We are going to ask him at the end 
of the term to compare his experiences with the students he had last fall, 
»whp_had had. Chem 13 the previous year with Bakker,-a8 opposed to students 
he had hlfiiself this past spring. Are they &s good Horary users thi^ fall 
as they were last fall? 



, Participant: What will the library agsignment for Cheo 51 be? ■ 

* ' ' * ^ . 

Tom: Well, they ate ^ping a number of" things.. They haye a nunber of ^ 
things they have to find: spectra from the spectra catalogs; and also 
frorf the original journals; '2) literature on aromaticity; 3) tliey 
have to hunt dovm* literature in relation to their laboratory work.i . . 
There are no library assignmentsf per se, but there is literature use in 
conjunction with other assignments.. It will be interesting 'to see how 
Vhose two groups differ. It wilVprobably determine, as long asQ^ are 
teaching these -courses, the shape of library instruction in ChemV^*, 

Participant: Do yqa have the Sadtler ^pect^um catalogs? ' " 

Tom: We hav^ the midget edition which, has 5000 spectrum. Wt do not iiave' 
•the complete ^(about 30,000) edition. We have several other sources v.ich • 
have more spectrum than that, padticularly . the new Aldrich catal<^. Bui 
the spectrum are much smaller, and th(? quality of the reproduce ionc ieaves 
sonetuing to be desired. Aldrich h^ about 13, GOO spectrum" lo chat o.nc 
catdlog. Are there any questions that you want to ask about this docu- 
meatation. I know it was flying by»pretty fast'. 'You are not going .be ■ 
able to ^^orb it at this poi&t, but you will at le^st have it to refer to. 

Participant: In addition to this one houri you have a hands on period in 
the library? 

Tom: The exercises are all hands on. I participate in this the say wa^ 
I do -in cne biology guixied exercises. We are available. We encourage them 
to not let frustration get in their way. Tney should come and ask for* 
help oexore the -frustration level gets high. We think that personal con-- 
tact is very importapt any time, even'whei; you have an 'iexercise which is ■ 
somewhat mechtoical and apersonal. ' * j 

Let me jv*? take a minute now to explain what the' strategy is for 
•the rest of the*workshpp~what the expectations are. First of all, a 
couple of things that we are going to pass out, without comment, andi 
these^are samples of. material that come from other institutions. LOEX, . 
I don t know hovf many of the faculty know of something i^illed LOEX, it is 
the Library Orientation and Instruction Exchange— a national cl^ringhouse 
that collects and di"sseminates information on bibliographic instruction, 
in acad^ic libraries.. They have put together a display of the best 
things that aj:e available around the country in science undergraduate ' 
education for O^rary instrucfion use. Tne materials are on tnis table 
and will te theft all ^ay and tomorrow so that ybu can come in any time during 
the rest of -the day, this evening, and tomorrow. If you see anything y^u 
would like to have,, we can photocopy it for you or -we caii write to the 
orl^in^l author, jvrtiich in most cases is a university or an academic library. 
I also, have hecej and I will pass this out, a flyer on project LOEX, and 
a copy of thei:> ineobersivip questionnaire. Membership at this point is free, 
the only obligation is that, you fiil out 'thexjuestionnaire form which, 
docdpients what yod afe. doing at the ■parficuj.ar time you fj^H out the question- 
naire, i^nd there le d newsletter u:hey publish and by filling out the 
questionnaire, you will get^on-the newsletter ikilijg. 'Then I also have 



university of Rhode Island. yL : 
and Nutritional Sciences program, and another is from Cedar Crest Coil^.e 
Allentovm. PA, ■ Thes. tVo institutions were applicants to -this .or^^^' 
but in my assessment of their application. I ^elt that' they were wail beyond 

' he f^culL . -"^^y i^-e a good working relation h' -p'k i 

the facuUy, and an on-going pfografc. (Copies are included here.) ■ 

Steve. Nelson: Could I put it> , pi^-for-EIieTr5ject^ar^ve Lincwood and 

IniT.T. P'"^"' '""'^^^ ^^-^ '-'-^t runeing.' 

tnis project here, and we are tr^/ing to find out wr^t pedple are doing , 

t'ne llbraHanr^r';'' ^'"^ "i-^ist doing the t.achin^,.s'f rc. 

with each irhL' ^^'^^^^ '"^^ country, i'n contact 

of % thJL t ^' necessarily a snowballing. skin^i:ig' the vcves kind 

Vource^ f^f'r °f eventually -coming up with a handbook 

erouo^f '"'"S that wi-11 be useful to elth.r " 

Sns-ible for"'^:? °" some.of our mailing lists already, we are 

respons-ible for deforestation, too. let me, pass out a letter that we sent 
out, to some people already and >a list of some citations ar?a sources- that ' 

^ach?.. J . bit larger than library use. It has to do with the 
-teaching of scientific communication in general. Tnat is wJTy.t-he list of ' 

out it is totally new to a lot of the people to whom we talk. ' 




Tom Kirk; Lef me start Jlihis evening by fntroduci^ the now faco f^mor^st ^ 
bs. D^ck Jphnson is with^ us this evening'. ' H6 €/ psychologist 1*^ 
ing> was at Eajflham, left Earlhara^and went toyche Ez^kon Foundation as a 
program director interested in evaluatio.n .of/GdticatiQnal progruino^^ and . 
returned this Fall tt)fEaflham aTrd • is *€6nsu>t ing wfth faculty inutile .H'^.a ^ ^ 
of ins true tjional development. We 'at JEarlJ^aa'y particularly those In the . 
library staff, feel, extremely grateful Jto have Dick around becauR^fi?^ 
is sensitive to,^{ie kinds of concerns have about effective library 
us^ a^d at the kamo. time "is a very h^d-n^sed person about *goad evaluation 
design. We are 'looking forward to/Vorking with him in a' nunbc^ of projects 
in the next few years, in- .terms orf evaluation of our pVbgran.^ JTonight^s 
sess^ion will be a learning expef^ence for me, a^ well as p^rh.aps the rest- 
ot you. What we are going to/dd': I'm going to make ^ome brief commits 
in relation to the documents I passed around!, to give you. some id^^ri 'of c^e • 
kinds of things w^ triedyro do. Then Jerry Woolpy* is going' to mal:a a few ^ • 
comments about what fche/Biology .Department has^ done in terms pf tryin^i-co ' 
get a feel for fhe^ef^Pectiyeness of what we have doner> Dick will cone in • * 
with some general S^mments as an outsider , perhaps, leaking a*t what wt- .have 
done and some of/Tne more general proble^is'of evaluation of eoucatiorrc.i 
program and th^we are |oing to open it up 'for discussion. Quite^'cif ferent • 
/from most of/toda.y when we were trying to jiresent to you -a program with which 
•we are verjr comfortable. What we present tonight we don't feel as .conf ortaale 
about, l^don't thinJ|panybody has an answer to the question of huw to evaluate, 
a bib^^i&graphic instruction ^program to^the^satisrfaction-of some*body elfie/ 
Hayp/ they have satisfied themselves,' but thiy aren't able to conviri'ce r.«ybody 




The 'materials you have falt|into two*<?SK:egories. (1)" Some are internal,'^ 
that is we use them within f^e course and have not 'been used to evalaaCe the 
program but rather to gi-ve feedback fo the student: these Sre ^ library 
quiz and the bibliography evaluation^ (attached) You also have a copy.pf 
tfae.quiz students take after ch^y ,have completjed the'guided exercise. Sosie 
re^yits of the. quiz^ from the previgos acadfeniic year are ^tfached to the quiz. ^ ^ 
Cer^osed) The qi^iz is used int^emally, and you see some results of 6no '/^"^ 
group of students from' last year? - Almost ai; quizzes' or all kinds of objec,tive&13 
testing that I have seen in the area of library instruction go to one qf. C^* e ' * 
two^extremes; i) they are so general in their 'questioning that 'any ifitelligent ^ 
person can answer them, or ii) they are so specialized that only a librarian 
can answer th6©. There seems to be nothing in-between th«t: is an accurate 
measure of a student's Capabilities in using -the libr^y, Th^refoire, I have \ / 
serious questions about the ability of thiSL kind of test to. 'give us any real' 
measure of the effectiveness of student's ability to use the- library, I suspect 
yoi^might ask why we continufe to •use it. In some sense it is an attempt -to 
coerce thp students into taking tfie exercise a little more seriously than they' . 
might oCherwJ.se. ^ Secondly, I hope the questions asked emphasize the majo*^ points^ 
we want them to^^get oufc of the exercise. ' So th^serious student who goes back 
ind looks at the answers to the .quiz and what they got wrong, will get a reinforce 
ment or check on what the exercise coversi TBut .lil terms of whether there , is - 
a correlation between the student who does well on. the quiz and is A good library 
user, we haven't r'eally looked at that in any sttious way. We hope to Be doing 
more of that in the next.- few years ♦ , ♦ " - * j > 

The second form is thre^ bibliography Evaluation ^orm, *and th^s is an attempt 
to ^ive the student some feeling for the quality of ^the bibliographx ^ » 
very rapid way* The reason it >as to be doipie rapidly Is that I have to look 
at all pf them in a large class' (273 students), within a two week period. 
Tfie form must be something that is pretty straight forward and therefore is 

■ - • * .. 108 • V •. * ■ ^ 
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a- very rough approximation of the cjuality of "the bibliography. Of course, • 
there is a lot of room for jiidgment on the definition of ' the. word appropriateness », 
so it i-s open to air- kinds -^f interpretation, and it would be very difficult - 
to compare the reSu^ts 9f one group 'with another, using this criccria. But,' 
; again, for internal purposes within the course, it has the effect, I hope, in 
; convincijig the student that, we take seriously the quality thV bibliography, 
: and they ar6 going to get some fairly personal immediate feedback 0:1 huw 
. good^the bibliography realty was.. We have "'a little more data oa the results, 
of this particular ^valuation over several years. ^ -We origitially 'did spme . 
experimental, work back in 1968 and' 1969 using.' a less fe-fiHed form of this - 
particular device. * There were t^o experimental groups that we were working 
with: an experimental "group and a control group. ►Those mean scores are not* ■ 
significantly jdiffdrent .(18.6 and 1^.'3).. Those have been tes'ted j^H||^lly . 
and they are not ^ignificaat. . The rest o^' the date for 1973, '74^B^|I^ 
_^-'76, has been collected in a less formal way. We have" not ^%ce^^i*e ^ ' 

data statistically, but yoa get some, feeling for the^ kind ^^is^ri button " ^ . 
" -. °^ scores there for last yearns' class and then you__get some mean scopes for the 

/ • previous three years, 19-73, '74 and '75. You g-et . some idea, of the range of 
1. ' ^ possible scores. Again, this is not an evaluation of the success failure 



of the instjucttonal program. but as a vehicle for working with the stuaeixts. 



■(2) Our first serious attempt^ which I would try and deffend as evaluation 



is the next item,^ and that is the Library User^ Opinion Scale, (seu st-cac.-.ed) .^^} 
This scale was developed, by a psychologist end librarian here iased on soma 
work that was done at the University of Colorado under John Lubans, Educating " 
Sftg. Library User , pp. 232-253. R.R. 3oukf:r, New York ,^974. "A" through . 
h ate. eaeh different. groups of students and thosfe. ^ interpreted for you 
«n the next page. "A" being the freshman Students of last year'^hich is when 
we first us^d the opinion, scale. *I would like you to look particularly at 
questions twp^and three. Let's take those. Kere'we see a pattern with a 
.group of 358 freshmen who strongly agree that the main job of a librarian is 
to check odt b'ooks, but we were very hearfened to find that- groups "B" (freshmen 
from the general biology couifse after a term and a half at Earlham) and groups 
C and "D" (samples of seniors) have been able to reverse their opinions of 
.librarians. . In question 3, "any taxing that you can't learn about the use of 
the library in th hour is probably not worth knowing," freshmen agree or 

f^l^ "^^"^ '^'^^ "^'^ h^^^ ^een able to turn that around in "B", ' 

C .and J) r Wc were-feeling very-good about this evaluation until the 
results from this year's frefehman class came in; and thar is tne"^" group. 

^a^rticipant: .Now where are you going' to go? ••■ , " >- 

Tom*Kirltj__ .We started out trying to do' an evaluation of chUges in student 
attitudes, and we'.^et this ringer''"of ,a' new fr«shman class comijig in and they - 
are'the same as our upper classmen. What do we do? Is last yearns ^freshman 
class an aberdtibn? • Do .we' give up* our library instruction -prograr^ecause 
all of our new, students coming in already have appropriate attitud'es? Well, 
obviously, it needs soipe more study. ' Dick has suggested that sonje of the " 
questions might be a little «too transparem:^ 'and that we need to think <of 
other, ways of^ getting- at the same information.- This is perhaps chQ one 
thing that I would leave with all of /ou, and the thing I- am most convince^a 
about is that librarians should not try to do too much in the way of Evaluation 
and test construction without the help of .some pr6f egsioaals. ' . 
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Nov, the. re-st of the data (see at tached> might of more interest to librarians 
^han it might be to faculty members .because these are the kinds of statistic^' MS 
that are kicked 'around, in the library profession.. They are visible indications vl> 

" of use of the library which might indicate the success or failure of an instruction 
program. '^Jl^ether or not the instruction program causes the us*e^ is not*" 
proven. There has not been much -in thre -way of serious use data" for 
academic libraries since about the early ^50 'js and we ne.ed to have more t 
' * comparative data from other ins^iitutions , and I would like to see otlicr 
institutions collecting this kind of data, so thart we cati get I't into the 
literature for , comparative pui^ose^. I for one would like, to know whiither 
the patterns of usa£e that were described in the '50*s arc stiil holding L-^- 
or whether they have changed. 

/ ■ . » . . • ^ 

Participant-: How can yo^ tell the use of peribciLcals that don' t- circulate * 

■ from the library?*" * . " 

Tom Kirk: Yes, we hive counted everything in-house. There ways of doing 
it. We have taken the stacifeard methods that are used in the liters :«rc in 
other studies of this kind. ^ . ^ ^ -I-s.'v 

asking the patrons to not reshelf, and the lib::ary staff reshelyes. In tr.is 
way we get a sampling which is apportion of the total use; it^& not <x record 
of total use. We have b^en using th«se^ figures , particularly the use oi the ' 
bound^ periodicals,* for ..administrative purposes ; 'decisions about budgets when 
«gjiget cuts come^ along. 

'Participant: How does that work? What doe^ the portion of use mean'^ 

I 



Tom Kirk: Other studies have shown that, the method we use is ^ saisplj 
technique which accurately' represents a portion of total use. But u-e con'r 
know wh^t ti^ p^ropof tion is in our situation. ./We oniy know from the other 
S'tu^ies' th^^i^the proportion- is anywhere fr6m a third to a fourth the tot a] 
yse. . '^^K ' - \ 
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Dick Johnson: , Tnat kind of thing might not work between institutions, 
your assumption he^e.ie that within an institution the r*ate ut which son:ebody 
reshelves might be the same regardless of periodical title. • 

Too Kirk: This is a two year study; the third ^r has-^j^st bee:l conrplotcd, 
and the data is being typed up now. The bound periodical use cata coaflrr^s 
i^radford's law of scattering^ to'a 'V' so anybody who tries to^ut>e thl^ kind 
of data to defend, library ia^tryction is in a little bit of croubl^^ bcc^v:^c 
it appears that the BraSford lay^ applies whether you have inteliigoat uaer.s 
not. 1 doq't know how much close scrutiny o^ these results you want to putr^ln , 
zfight now. I think perhaps some of the more general issuea about evalu::cion 
mignt be a more fruitful use of -our time this evening. We can come back, to this^ 
iryou have questions about particular pieces of information, and we can calk • 
individually if you have questions about it^ ^ • • , 

Jferi^y Woolpy: I want to start where you left off with the attitude suTvoy. ^ * - 
That second item that was so troublesome to us - this year's f resnmt^n 'con* c 
conform to the ^jnpdei, causes us. to reject the device. My impression* is that 
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that is what we dd when we do evaluation in general. If .it l:onf irms our ' ^ ^ 
preyiotts positions of what is going on, we tKink that it 'is effective 
evaluatipn,' and, if it doesn/t we decida we need a new measurement! I don*t 
^know whether that is fair, but it is in fact true. 
♦ * . ■w , 

I'wouid.like us to make a distinction between evaluation and student feedback. " 
That 'is, true evaluation in the s^e of control groups and .effective before- 
after measures probably can't be done by the instructor, ©r are not likely ''to 
be done by che instrjjctor in the usual" line of duty of teaching his cQurse, 
^ .1 suspect that that requires a kind of expertise that most teacf\ers or librarians 

•don t have; this is* an 6xpertiie in testing. Ev^ if they do, it takes' sp ' 
• mch time and effort that they probably won!t ifiv'est it. In general, good- 
evaluation, if it is done at all, is probably cone_by outsiders, at least bv ' 
somebody not directly involved. I think cha't it is probably appropriate^ It ' 
is like^the separation between auditor and" bookkeeper. *Ypu don't ase the sane 
person to audit your books as to record the figures on a day to day basis. ^ 
So what I have done here, I don't want to confuse with evaluation. I have 
gotten feedback from, people >ho have taken the course and triad to count and ^ 
measure what_they say abo^t it. I don't think it bears much relationship t<5 
their actual behavior but some probably. .What that reiationshi? is, it would 
be very ha^d to estimate. Whkt it does show is something of what their attirudes 
are. At the end of each- term that we teach this course, we have given a battery 
of multiple choice type questions which include some. items which I have duplicated 
for Jrou here'. 'We usually ask them about 30- or 40 questions which include every 
aspect of the course .we can think 'of. Did you like the text? Did you think 
we used the^text appropriately? Did you enjoy Versus did you •learn a io^' from 
ic? Which were your favorite lectures? Vfiich were your le'aSt favorite? ' Which 
were the most enjoyable versus wftich were theisost educational? We get all 
kinds of attitude surveys like that and tried to follow-up pn them by- changing 
the course the following year. I've, pulled some questions th^t pertain directly 
to the litrary assignments in the hopes that th'&y might show something about the 
attitudes, (see attached) "Was the Ubrary overemphasized?" Thirty per -^ent \17J 
agreed that it was over emphasized, but 69% thought it was appropri^ely eiphasizedT 
You heard this morning that a lot of people spend a lot of time on tfhks^ assign- 
ments, so that is what they mean by emphasis. "Coimnent briefly on librAry 
examinations as an educational device" - 92%; say it is valuable as o??oSd to 
not valuable. That is the kind of thing we like' to hear 'so it must be a kood 
device! Of course they jcnow- that when they fill it out; this is * anonymouA 
rney^ do know what we want to hear, and we have beCT telling them what we w^t - 
to near all year. We keep telling thea that this is an important experienc^. ^ ' 
Remember I told you that this morning, I va^ just, playing it jBtraighf. I tell ' 
^ them all the time that this is.a'good experience. Bxaoinations ; there is ^• 
nour exam as opposed to what I call library' exams ^ich. are alternated in ■ " 
different sections in different phases of the course, one' substituted for the- 
o^r. You see 482 learned less frra them than the library- exam; in other words 
they thought the library exams were better learning situations. How about 
worked hard: well,' they always Worked harder for the library exam, if that is ^ 
^important. Then I will give you an over all statemeht. The best course I 
ever took: 28Z; that's really not very good, I ^suspect, relatively speakfjig 
•in the college, although I'm no*t sure. If yoa were to adq up every student 
that thqu^t every course was the best, you wotild find out that there were 
_ considerably oore than lOOZ. At least that has been my experience with 
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ev^uation* "1 worked hair 
85i agreed. Average njumfaei: 
we've heard some woeful pal 



thl^ cburse than otI«i^2" Ciearly thuy did - 
'hoyrs^,per week. ^In 'fepite'oi' the fact that 
, today ^bout how laany hours individual students 
have spent, it avc^gl^ 'ouC *^out f i'ftfeen iiours wlj^th; is what the college 
standards are. Jt looks Ui«;three-quar ters^.tf^ th^ class* fs in that range. 
And some of tiiem, ^^^jiij)stan5'ial portipn, axfe^under 10. Tlte ones that are over^' 
twenty^jl^ally complain alot . - .» , • ^ 
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•Jerry Bakker;^The intriguing thing there thougi) is that, this is considerably 
less than the college expectation is,^ and yi^t ^5% say they've w6rked harder 
on this course than on others^^^J ^' < • > 

Jerry Woolpy: Ri^ht, so in fact^ what. Jerry is si^gesti^g and night be concluc 
frdm-this, or. at least guessed at is that they doL't work 15 hours in each 
course.' And I'm sure that *s,t rue .*^ow the numbers ar-e tp6 si£.li to make 
any sense out of II, I ^ive them to you anyway! because I wanted to show 
you that we were at least* trying to look at ^ome o|f the possible correlations. 
Nine students who said that they* expected tO:get ah A in the course claimed they 
learned more* from the library e3?am, and thea^compata-that to the C 'students,. 
502. Which iftakes it look like the IC^tudents are getting more put bl the library 
than the A students. So .1 don't know, like I said ^pefoise, the numDers are so 

in't want to place any stock in that; 



And the 



ICC :hr.t the 
t rouble- 



small -that you wouldn c want to place any stOCjc in th^ 
3 student doesn't follow the trend', and be becween the A and the C, 
some with that interpretation, ^ut maybe there's tiingSj^^here chac ar^ linearly 
related. In any case, we're '-iooking f<?r those kindi'of trends ar.d'vc r.^v^^n't 
found any clear indication that the^tlidents that ar^ doing different 
of work ai^e^ responding to this differently. 

Jerry Bakker: Yes, but the diffe;.rence between the A knd the C could be 
just as easily explained by saying* the dumb students like libraries and dislike 
hour exams'. ' •* ^ ^ * \ 

' \ * / ^ 

Jerry Wooipy: III^ is a general qv4estion which we have fesked for nine "years' 

with. no substantial difference. The library is always thought to be more ^ 

difficult and time consumsjing, but* appreciated more. Sode graduating seniors^ 

who were polled last yea«: about what they ^thoyght-^of their general educc^tion ' " 

courses, cited the General Biology libt^ary experience as Wing one of , the nx>st 

important things about their general education. We've gdt ten several antidotal , 

accounts from biology graduates in, graduate school who rcdort, as I cold you 

last night,, that they're more capl^ble in'^rese^irch, .and paiticulariy m initiating 

research, indepen^nt .^t^dles, an^ term papei/s, than theirlfellov .^tuiento. 



ng- 



It has "oeen cTonsisL^ontly r^eported, ''that thel4? fellow -radu*ke stuucnts, don't 
Icno'w how to use the library and by that jOj^ mean they don'T know tlie first thi 
abput what information tools there are. -^^ey "have heard abdiit 3io. Abstraets 
for sure. They probably have'sose ide? /ow to use them, h But they haven't heard • 
of Science C itation Index and -tlie^r wouida;' ^ kno^ how to really search a topic 
in the way that you have already done /toiay. Kow^as I said kn the beginning, 
this is not what I would coasidiir ev^uation. This is aA^tttudc sur-/cy that's 
pleasing to the people that do the ^Jourse, and ix helps tphea to some •extent to 
modify a course in\the.dirfect;to&c o/ student opinion. CJYr'^not in the direction, 
at least to f^nd put how we're getting across., I use tt) think this wa^ evaluation 
but I'm sure it^ isn't now. X.k^q, %o tjiink it because' I put a lot of time into 
writing thoSe questions *and Soy£«:th and I just got carried i^^ray wij^h it. But 
nov7 that I've been^^thinking aj^ut" evaluation, T recognize that I'm iever soing 



,co be able, -to .4o ie witSi my- own . courses . 

Question:* Have you ever', tried, to relate results to class scaadinz''^ 

^ Jerry Woolpy: Yes, I ' ve .^one ' that and thfe seniors are less, patient, Eore ' 
exasperated, and , the fresKaen are core easily enthusiastic.- There is not 
nuch othec difference. Bi^C we never " have .enough, numbers froa the upper 

^ olassnen to be able to do nuch with then. I reCoaaend doing these kinds 
of ihings, incideritiaily, but not making- clains about this as foraal 
• evaluation; I think it's helpful to* do this kind 6f thia^ and then engage 
a course in the directJ:on .thap students, seea to be. indic^tiijg. 3ut' one. 
thing you can find out froa thl.3 ,ik working people too bard, or what they 
clain to be too hard, is not something that will get a 'course a bad racing. 
That IS, we consistently got told we' were working then .too hard, on% we 
also got consistently told positlv^, things about the course. We also found 
that when an assignnent was enjoyable there was alsd claini-that- t£ey. learned 
alot. On very few questions did they separate oilt appreciation/eajoyaent froa 
learning. Ndw I don ' t know vhetfi^r tint's real or not. §ut thac's-£he kind 
or results that ve get. • . O 

Question: Do the" students have soae*sort *f " a survey for every^course that 
they take? ^ - , - . ' 

Jer^ Woolpy: Kp. Tne College places sore eapbasis on teacher evaluation. > 
tnan cou^ evaluation hpre. At least iat^l recently but I chink we're 
aovxng away ,fron that.' W? h^ve gotten verj? .n?rvou.> ^bout 7roi:^tion and chat 
sort or tning, and we require our faculty to do student evaluationi of teachers 
at the end of each course. As a result of this, there's k great dea" of 
nervousness. We are ooving away froa that ^ little b^t jioW, or at least we ' 
aa^e the questions aore general and encourage people to d<r course evaluation 
xn addition to <eacher evaluation. Tnat is to ask questions about t.-.e materials 
or tne course and also 5:0 ask questions ik the aiddle of the tera instead^ 
at the end, or faoths t ' 

Question: You said chat it was a aistake for^the instructor to- evaluate 
his own course. ■ - , - 

Jerry Woolpy: In th^ sense that objecbr^^iy is very difficult. 

Question: Then wouldn't. it" be a vs^e/ti^ then for these studeats who are ■ 
taking the course -to evaluate the instructor? q 7--f 

Jerry Woolpy: , Yeah, I follow' your lliie of reasoning knd 1 thirJc J:hac in aany 
cases it s not an effective- way of evaluatiirg. But I don't think ve can ignore 
that information either. That is,^ I think that student response to a Veacher 
aakes some difference. ' " " 

- - ^ \ 

-^Participant: There is so nuch t«apta£ion to 'evaluate th§ teacher as a good 

guy ox a bad guy, and^not for intellectual .content of wi^t" got- exchanged. It . 
.takes a lot of tijae before you can do th^t. Coae b^ five years later cad ^ 

tell Be wha£.jrou think of that course. , 

Jerry Woolpy: We'd. also "like to find out five years later whether they do 

more vork the library than the control groVp. Whether we aadefaay iapression 



/ 



,on thea that way. We don't iave -this inforaation* We calked about applying, 
for a grant to go chase after our people ar.d exaiiine theia about -.thfe impression, 
that various courses have left on thea. But ve*ve never done it; * . - 

^ f 

Dick Jphnson: And njw I'p suppose to cone up with the pet solution that for 
all of you would be a nice.n^at forzsulaJ Khar I thought probably I could do 
^aost usefully %s to go back and fcrth on specific issues that you z^ay have, 
talking perhap^ about gozie of these things as horrible esaztples. t>ne thins ^ 
you start talking about eva^uat^on, library evaluation, it looks li^e-i£'s a 




.^t an area and it looks like it's a little core applied ratr.cr t:.^% i^.^.c. Zi^^ 
^ a little trickier because there ^re a lot tiore variables, you don':: r^-'i- It 
a laboratory tcj control it, othervlfe it's basically that kir;c of nrTTt>.c«> 
it's a problen in experimental design. And that has ^een the dc^x^Jr.^ 
In thinking I think for twenty yea« or i^re anyway, I would- l^bel tciuz the 
logic of the evaluation. Tnat is,^one *can talk about the ways in vh^cn w^ ^ 
-think ^about the^ things that io into^a design in ten::^ of the logic of how 
the/ internet. Part of what I want" to talk to you about is that, the 
logic of evaluation. One pf the probl^ wiSi this is that isore recently 
there has been aore and zsore concern about whether or x^t-the basic paradigm 
of research r-eaily doe^ fit instructional prog^an eval-atior^. T.-^r^ ur^ 
been a lot 6i discussion^ for exarple, in the i^irddle 60 vher^ pjei: and 
Stanley go off into talking about qiiasi-e>:perir^tal de^sign. ^'Ci^pbvl., :.^r.ald T. 
• and jiiiian C, S^nley. 1966. Experiiiental and Cuasl-E>rperiT:"tc'l 
^^or Research . Kew York: Rand->^Kalley pp,) You cac^t cuite ^p^rl- . 
cental designs in this area, but there are sos^ that look like ezpesdrintal 
designs .but they got problems in thei^r, Hore recently fr.^^ cave been 

other discussions which are Jre&lly raising, I wo-old. say, verr^i^f f^rant itocels' 
of^what the logic is for designing an evaluation, Kichaal Scriven, for example, 
recently has ralked about a podds operandi approach to evaluation. (Scri%^en, 
Kichael. 1976, Maximizing the Power of Causal Investigations: The Modus* 
Operandi Ketho^. Pp. 101-118 IN 6lasa, Gene .V., ed., Evaluation Stucies . 
Pveview An nual vol. 1. Beverly Hills^ Sage Publications) People like Kalcoln - 
Parlett are talking about illmfnative evaluation. (Parlett, Kalcolr. 1976.. 
Evaluation as Zllupination: A Kew Approach the Study of Innovatory Programs 
??* 140-157 IK Glass, Cene V., ed.. Evaluation Studies Review Ar^nual, vol i. 
. Sever ly Hills: . Sage Publication^.) Tney are sore anthr^opological models of 
evaluation. The arguitents here are* going something like, this: in a ndrzaal 
pied^ of basic research the design^ of the research is related to the <jucstions 
you're askiiig, and the research is' designed for those ends. In a t^'picnl 
evaluation^, .^he desigR of evaitiation cozies after the fact. Rent's a ^,sia^ 
'under operation, here's* an innovation, here's a 'new coutse, and now let's 
design the evaluation around it so the ^alu^tion zust necessarily :>e secondary. 
You've got a problea to begin with; the design of ifte incxiiry is deptiddcnt 
on tlji^desi^ o^f the ptograsa. Ko^ this is to sor^extent the ssse kind of^ 
problea that one ssight have in a^li^ ateas like engineering or so-ething 
like that. But not quite. You'jeet into spae sessy probiess in bus^' t^a^ineeriag, 
I guess, you could say in educatiSh and libraries.^ Another probl^' is that*' - 
these are treaendously cosspUe^tea sjrstesss. -^People talk about srolti-uetcfrxainatioa 
Of things.' For exac5>le,vyou get sose lovely statistics on librar>- circulation. 
What is iv jthat leads people td take out or nf>t take oxit bOok«". ' Jugt ii^gine ^ 
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cne tactors involved in that. Besides v for exarjple, iruiCrucrion ir. ITirary 
techniques. I can reoeaber a friend of rune in ijraduate sciiooi, coui^ 
talkydbout'andcher thing one could evaluate libraries for. People goic? 
CO ybraries sitting in thea,, there have been counts on that ur.dou:> I v . 
And this guy varied his sitting and working in .the librr.ry an^ ic . 
do with the fact that his a?art=enc uaheated. So one could s^i, 
in Che library sore often at certain ti=es than at other cir.fcs becau.. 
studied -there auch iwre coi^ortably. Tae point, of ail this is wnen you get 
into niE2an sysce^s the kinds of outccses chat you look at are decerninec by a 
lot of factors, and when you cry to sort out one factor and cr^,- to Jinc our^' 
^vnac it is, it's very difficult. On a corajlicatec systen ons ^ do severe' 
tninss. toe can tr>' to si::?lify it, aad this is The general Isbcr^tcry 
approacn, ^et » get rid of all those oc^er factors. Ar.c then vou -^i a 

library- ins cr«ctt«i vhsrs you're r,^z „cin'- :c li: 
the kids in the library except S^viJi^, yoa knov, you .^ec very ?u::nv kir.ds 
or situations. Or else you get^ into ^enorr^us masses , of data vherc' 70-' 
trying to factor out those things -by looking at different sy5te53 ;:;erate 
iti diiferent ways. ?eo?le,.have pointed car that this izav be a bas.c -.r.-f 
xn eva^uatioC;cesearch. These are, in a sen^^, insoluable issues ^-d p..-." -.his 
type ♦yf evaluation in a..diff erect domain than basic research because vc_' don't 
«ave control over those iuLnds of things and you say need a different L-d of ' 
•tning. •. . 



Participant: ^ne lij^ary in Madrid, Spain has a bar attached. 

Dick jo.-inson: Get gocKi nse around certain hours does it? Jj5- dor'- ■'-ve 
the= the exar right aftet^.". Tne point of all this is that^part 5f ih"!; 1 
want_io start out saying to you is to contradictr-=y colleag-aes here.' «' 
you start talkisjg about e\'alu4tion research, I think tr.ere are a let. err 
Girrereat kinds o^f evaluation. 1 what Jerry die; I vould lib;! i. 
evaluation, x.nerq have been so=e ver>- interesting dif ferences'^o ' 
to lorsal versus informal evaluation. While I understand wh^tl;..- : 
that isn't a very critical din^icyi to z£._ I start i=ki«Si4 bv v"::ng ' 
to ju:^ at' so=e other issues that co=e up around Evaluation trat '' " f^,- ^re 
very critical issues a^ I vouid like to point to the= and then 0.%. ' i 
tninK that there probably- ne^s to he a reaJ look at the poli-ic^ o- evr uitioh 
r,vai^tion is done for soaeti^g. evaluates a particular librar,- a^dSra:! 

.or one s own use; or perhaps one evaluates it to prove to the D.-..r. 'z%z jhis 
noney is wel2 spent; or to one's colleagues thaj: the librar-/ instruct.c.-^ ' 
wort.'wnile thing. So one of the points I would" want to nake here is that in 
oasic^ research. In not arguing that basic r6search has no goal to it but 
tndre s. an extrinsic foreness in evaluation research that I think ve cugrt 
not to ignore, hut I think we ought co point to and look at. 'l Break in tape.'"; 
«na you s^ee probably that's going to coae at least in part f r^u t.te psyc...losi/t 
o^cause it s treatad & a class project which is related to the stuc^nc . -^-^^21: 
about daca in the literature of pqfchology. One of the things that's z^ix^ ^ 
nappen is the design now, we're noc through with it yet. Tnis dofrsn'c h^en 
txx^ Jaooary, so it =ust change ten tW at -least in the next two ^nths. 
idea .s chat early in the course, two .or three days after the student arrives, 
uney re given a problea diat they're going to have to' research in the library, 
aad to iBsure cJjat n5t-Eoo such student tiae is spent on it/ they will pa ziZd 
They ve got .a period of tlse in which tt^ey're suppose'to iiasdle this probleo by 
searching foV those sources. Then l^ter on -coses the library lastractioa and 
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ic's- feoing CO ccf^sejin a different contexc because we gee zu^jr^ worMri^ or. 
specif ic exercises where theyVe goiag after naterial^ So ir von*, necessarily 
be .related 'co that, an(i then •further on there's goin^ to be t*. y * " ^ 

exercise repeated with a different, as^gnit^nt, and again the^tl^c *rrran^,cr.Lnt. 
^One or the problems soisetiines i^ tha% you choose a =:uasur^n- dvvlc^ '^..r^ ::.n't 
particulariN^seasitive to di/ferences. You have tc^ :*-ink abou;^ t:.e dirffcrcritra: 
you re wanting to sake. If you've got an e>rpcrir.^ntal -rot.^ -hd vou've gor^ 
a control V<?u?, ^nd. yotr ine'a^^ with a tas^T that noj^y can tney Ibo/. :hc^ 



:ion 



sase 



Or 



1^ you n:ea^ure with a task^hat everyb§Jy .can 



So you've g6t to p^ick a task oi the 
grc^s. And when you^re looking at' iaclvid; 



-ooic tnc 



see dif ferer\<:§s at:r^D| tper^ 



Lcu-ty so tnoy laj.-. intc^ two 
"Students, when you're trying 

And pare of what we'te/t.oping co'^do in' tirin.^ this ir^r'cvi-'z :,:_G....:i :r.„' 
covering up .their sloppin^ss by spending rore tine. w;:-rp hc^irr^ a.le 
to airrerentiate tie effects of library instr-udcion tUt '^y. i-t .t 



to 





be a straight pre-post experisent at this paaicula 
whkt it looks like now. ' * 



x^^p t 



Participant^ 
criteria- 



ine tiding thing as^t^s that they al^ =eet a nini=:un: 'performance 



Dick yohnsco:, xney'/l be given say two hours in vhich tt> deal viir. this 
?rob/e=. We're taxkaog nov aoQut the fact that they're going to :a>-c ^ 
t^perecorder vTth then. Tney're given a problem and t;-.ey're gcin- ;j f^i^ 
into the tape recorder reporting on whar they 're_do_lng.- So the tl.-^ vlz^U 
is their tim.ng de'/ice and iC also gives- us a scrcas, in effect a ch.. .-. 
journal, of exactly whiii's going on and hpw long ir took the:z to i 
5.nc tneir co=:.ents. Part of vhat we're getting them, to do this for 
going to use then in a da« reduction exercise and star't talking ^cout ^ 
cata or how hu=ians process inf on:;ation. io i; vorks nicely ir. p.v...o.T^/ ;c 
Anc we can then. t;alk about translating this taped- data frozi tne -llsi 
into a ZLatrix of eata to look at husaa inforsat^oa -processing. So, vc'.l gc 
3o=;e^ journal type data on their going through A^- exercise, we'll -^i ■ 
tney rev able to achieve at the end *of the fixed "period of ti=e, an- -.c'/c 
so_e de-bugging to figure out what the tine should be. He said nc K.re tr.a-^ 
two -hours, saybe it will be less, aaybe we'll have to go oore. Z^i .....c vou 
o on these kinds of, things is y<yu need to really run a-^-v stuu^-'r.Co 



/ 



need to do 



rnrougn^it to sake sure it doesn't Sail flat on its face. 

I can talk c^re specifically on the logic of Evaluation, but there arc .1 sit 

o: good text books in the area that you can look at and it's better infor- 
> ^nation cojsauaication then ny sitting herer-3I^a-,talkini to you abuut it. -.Ve cjn 

talk a&o^lt coijtrol m-oups, and we can (talk aboitt ail these kinco o: chjn-s'i: 
•ydu want to« I thii* it laight be aore usefiiTTo talk about purposes and^wh^t it 

is you want to seasure. / 

' " ' ' i 

Participant: You talked about using- the evaluation to gauge the prbgfess of 

wnatever task you're doing. Could this siaply be a very perceptiv/instructor , ' 
wfao^ is aware of these things and siaply by thinking abbut what' is happening, 'his 
won t be a foraal evaluation, of course, will be able to alter or continue "the 
course? , • " ' . ■ 
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Dick: I think all of us in. the widest sense o£ the term are evaluaciag. 
^ I think the problqp, and here's where I cpme down hard and aavbe 1'e - 
going ^in your direction, Jerry, when you talk about formal. :The problan 
witn informal evaluation is that some of the errors that crhso into all f 
evaluation are very likely there. Hor eiiaaple, sacpXia-g error. Kow if 
you get into any fonaal evaluation they start ^Srrying ri-ht 'away about 
saapling error. The worst kind of sampling isrrbr is the guy who after ' 
his lecture rates ^hat lecture on the basis of the three students who 
came up and talked to him and pattpd hia on the oack_and said great when" 
there were 80 in the class. Tnat is a sampling error, and it's an awful 
saapling error, and unless that professor is purposely xryirig to get oirts-^e 
«p-tnat kind or sample yoy've got problems. The ocher problem is tha'c we're 
not good information processers unless we train ourselves to do that. .1 
reaember one of the first classes that I ever caoec was o: me leading' a_ 
discussion. 1 was confident I'd led a good discussion, with a :i%v.v o.5cuii.ion' 
and good class participation. But wha? 1 did as I went back over that cape. . 
i counted the people ttiat responded, and I checked the time thcf t. ev s?e-.- 
talg.ng as opposed to what I spent taHclng. It was a very humbling e>:pcrie.-ce 
tJJ^scover that there weren*t quite as many people talking as I had thought; 
th^ipe was, and som^^ of those brilliant comments tiiat had Eeeft mad^ had oeen 
oaae oy me 3nd not oy students out there. So. some of this getting outside of 
tne xnrormal system and pushing yourself to test against things that are a 
xactle core objective I think is a good idea. So. I'd like to see us he * 
perceptive, and I think a lot of things that go on, as 3^e adjust courses 
como to_us informally this way. And I'm cejrtainly not saying don't ll-st^n -^i^ 
to tnen, you know, you get a graduate student coming up to you a..d ..v. 

.*ow I m way ahead of everybody els^." You don't *tell him don't te^. n-c"' 
tnat, write it down on your answer fo this Question here. Balony t — ^ 
ridiculous! But on the other hand, whenever you're gathering c4ta relate! 
to an evali^tion you ought to be aware of the bias' of the cacc' Ti ore is 
no Scientific instrument that I know of in any field that measured vie: out 
error. But the important thing is, being able to estimate that error zq 
Know. how big it is, to get ^n idea whether or not it's a const-nt .rror in 
one direction. And these are the ways that v»e've got to tune our^elvL-. us 
well whenvft're doing evaluation on this kind of instruction. O.-e of the \^ 
o:cks I'd have with you here (referring to the Sibliography 'Evaluation Form) - 
is thSt I tnink you could tune your error finer 'and you migri see something " 
there. That some of the differences you're getting are really interestfng 
aifrfijfeaces. and i^ you get that';reliabiiity up you've got a chance £hat this " 
kind of £ft^,ng could be a very very interesting' piece of data. 

Participant: What would you recommend for it? ♦ - * * 

Dick: Well, they 're 'easy solutions like' extending the length of it. One of 
the ways yorS get higher reliability is to extend the length 6z the instrument. 
But of couf^e, Ve're run3jing right smack i^to economics. Another thing that , 
would have been ihterestidg- would be try to do-^ome work getting sc^e other 
raters in th^ejre and looking at your scales to see if yo^' could build sose better " 
scales where ;35<«- get, sos^ very ni58. tuning. Partly I'd love to go over your . 
data and look at the raw data* to see what that scatter looks" ifke. Tnst's ^ 
a veryrsaaU scale, and to.get a difference of 16 to 18 is a fairly lar^a 
difference. You must have been getting a.lQt of scattet in the data, and i 
it would be Interesting to look at that scatter to see what it looks like. 
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/ Participant: What are you talking al^ut? 

I was talking about the BibUography Evaluation, 'l find this extremely 



What are you calkipg ai^t 
D;ck'^ I was talking about the Bibli „ , , 

intriguing. -The to|o samples you've got 'look Uke neat 'clear-cut and even T 
can notice the difference between the two, and I probably ^.would rai<. l\\^z. 
the same- directiod' you do. .Now,. as soon as I went through' this awl cficd 
to score it, I flidn't come out with the scor6 you have. And :f it's the 
pase that your scatter in scoring has got an earror in it, you're -fiuccu^ring' 
up ^d down, thenVthe bigger that errox is when you try to cospare two groups 
with each -other yoji're going to get a lot of overlap i,n these giToups ^cause of 
tnat random error. Aad if .ypu^can. cut that down, you can- see snail differences, 
.ou can do if other ways: you can e^qjand the size of the groups, you can exTJan^ 
cna sizh of the instrument to get a bigger scale. to measure on. Z^z t.iose ki-ds 
or thxngs alsojrun you into more mbney, and there may be some cheaper ways h 
working, with the instrument itself to make it morfe reliable. ' 

'i 

Participant: And how would you i<y thatfk 
t - • - ' ^ ^ ' ■ . . 

V Dick: I would* get some other racers ia, I^d do so=e uilot studies or. scale 
itseir to see if you could get that*'scaling so that people ca:. -ccUy ^ ree 

, See, part of what I'm telling you is that I. think that he probably Is a°poor 
raterf as we all are. Vhat you need to do is you<need-to build scales vhere 
you tan do a very reliible job. - . ' 

Participant:, When you sa^-scaling what do you mean? 

Dick: Let's imagine that you're looking at students vho are doing a 
. in the library, youVe following them around unknown t© them and vou'r.. rioting 
them as to how efficient th^y are iri finding the right sources, ar.d ytu u.t 
ratea tnis one 3 and 'that one 4 and so on. Now what I'm saying is, t;.cil ^."e 
judgemeijtal scales. Tnat's true.ia any kind of measuring we're coir.-, buc » 
sometimes the judgement can be made really piretty nipely and relitbly. If .-cju 
and I are reading a guage there we can do pretty- well i'f we know how t^ 
guages. But when we're starting to read students and let's read tUt criteria 
set down so that we'r.e coming out very close on those numbers, I go; Ver*/^-* ' 
worried about this guage that we're reading because it may be a different gulge 
or It may not be worth reading at' all if our numbers are rando;:: Scac:ers. So ' 
wnat you ve got to worry about in any measuring device is how reii^-ble is - z. ' 
Let s imagine this> You've beeA following the studen^t around rating him or 
her,^ and I ve been taping, the whole thing on video tape, and a month 'ate- 
I come back and say "o.k. I bet you-.'ve forgotten this, you watch the tcpe 
now ?nd raf^ again and we'll see if your numbers 'are the same." Kow if you've ■ 
got perfect reliability you ought to come up with she same number's again. To 
tne extent that your number ^re not the same thk second, time around, we're 
ytalkiflg about error in yot^-^cating scale., ^ut I 'm -saying the oroblem h£re 
is I 11 bet you if I got him to ratfr these papiets t»ver again usi-ng his very • 
scale, he won't come, up -with" the «ame nufibers. 

Participant: I ^can't understand bow your rating mSkes any difference ■- 
beca^e^^ you said you don't know anything aW it^. and so you'?e just 
pteking numbers,, ' ^ 
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Dick: I wa§?kidding in that. If I*m going to be a rater*, I bett;er Knbv 
these books.. ^The pToint 1 was making here is that you want to iooU 
j;<rf4ability because if you've got an instrument that's waivering all pv^r 
the place and you're looking at tH^s^ two groups how are you go^uri to find 
any dlfffereat bet\/een^ those, groups ujj;Less tile difference is^^nonnou^. 
part of what you ''ve got to do when you're measuring is try to look at the " 
reliability of the data and push it as far as you can in getting good 
reliability. * ' - ' 

Tom Kirk: Just* to Verify what Dick said, I 'tried in the last few days 
to re--eva:iuate those bibliographies using -the same criteria', and I couldn-S: 
come up with the same scores either. I couldn't justdfy the scores they 
came up with. Tbo?>e were done several years ago.^. .My eicpectations have 
changed. — ^ 

Dick: O.K. Now that's different though. That's not reliability. Whac 
you're saying is your measuring ii^trument has -changed. Once you'hav^ a 
measuring instrument it may drift over time, and I'm getting more and niore 
demanding in my expectations of students. . 

Participant: Are people g6ing to have a chance to get^ some reactions later 
on af tet they've thought further about what soct of evaluation they are go in 
to 'So on their own projects later on this year? ' ' 

Participant: I've been sitting here wondering if evaluation is necessary.' 
And the reason I say this is because Lucy Geckler and 1 are going to ^o 
home, you'll hear about' what we plan to do topoi?row^ we're goin^ to put..^^' * 
something in a vacuum and I don't nekZ to "^evaluate it. I knew that any- 
thing you put in t;hat vacuum. ni 11' be bet;ter than what's there /ndv. 

Participant 2: Will you be allowed to dp it >ear after year if -you donU-? 

Participant 3: If it doesn't take any more time "and money,' yes. 

Participant 1:' I would* take the position that I've listened to the .students 
as they complained year after year. I try t^o^ie^ intelligent , I'm kind and s< 
forth ip improving the system^ but I^m 'there^to teach physiology not teach 
library science. I want^them to know about ^library science so they can use 
the library to help themselves l^am physiology. Beyond that I don't care. 

Dick:- I bet you care abput the efficiency of<it though.^, 

Participant 1: The efficiency is going to*be"4006Z greater than what it 
is already, ■ ^ . . 

Dick: My first reaction would be to say liallelujah il you qiicstHon 
whether you need t6 do evaluations because that*s an ijapo^anl: first 
step. > ^ ' 

* ♦ 

Participant: Well maybe ten years from now somebody will scratch his 

gray beard and say' maybe we 'ought to evaluate this th£hg and sec J.f ve ' £ 

can't ijjjrrove It. • )( " 

! . ^ /: ^ \ \\ 

Jerry Woolpy; You might have some political things chat will require you... 
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Particif^nt: Like what? 

Jerry Woolpy: Like, for example, your college telling you tbat people taking 
^ your course are really cutting in bh doing homework in thci?_^ course. 

Participant: I'd say that your'have to ^ach a aoxe attractive course. 

> Jerry Woolpy f*" The kind of information you get when you don't evaluate is; 
a student says, "^{y* friend spent 48 hours this w'eek on, that library exani." 
Am I to go around thinking all iny students are spending 48 Hours, a week ^sc 
"t/ieir library work, \ \ must be way off on the timing ox this assignmen£/^^ 

' . . . ^ ' ' h 

Particpant: Well I will counter by. saying 'that you've b^en in this ^or ten 

or more years, wl're just, starting, , We woula^like to know what you SinS out 

when you -do your evaluations. ^ f-- ^ - 

Participant II: If you were 'starting off, what^ kind of things would you try to 
measure? Is the measurement- of -time that students spend pa. a^couxsej or at 
-least of their attitude toward it, appropriate? . ' ^ 

V 

, Dick: Don't get caught though on their nieasurementa^ What you've got 
to ask is <rhat is your program for, why are you thinking or pu'^tin^ 
evaluation in and what difference would it make to you 1: you cio ^/aluace. * 
If you can't answer that, it's going to make any difference, you s».o..^ar. ' u 
spend the money or time on evaluation* But if there's som'ethir.g Lr..^c couJ^d 
guide your program in its development later on ther* there may be a rcc:.v^r4 for- 
going ahead and doing some evaluation. 

Participant II: Well then let me turn it around here and say what are 
, • the kinds of things that would be most "helpful in this/ / 

Dick: This is going the wrong way around. We can count the bricks in 
the building, there are all sorts- of things we can do. 

Participknt It: Then what do you-ido? . 

Dick: There are lots of ^things that one can go around counting. What^ 
» you've g^t to do is you've got to think about why are we starting thi3 
program. . ^ 

Participant: I gave you my answer* 

/ Dick: O.K. "... \ 

Participant^: I w^nt tsj/dake it easifer for the kids to use the library- Tin 
not trying to seduce them iato^ using it more often. I just war^t to nake it 
e^siet when they do use it to get to .the information they need with more 
.ef/iClBncy. , . ' 
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